[ 471.802529] nova-scheduler[50475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 472.859075] nova-scheduler[50475]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 472.869536] nova-scheduler[50475]: DEBUG oslo_db.sqlalchemy.engines [None req-95576c08-f3b6-41ae-8191-8c6b1c2faf19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50475) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 472.984454] nova-scheduler[50475]: DEBUG nova.scheduler.host_manager [None req-95576c08-f3b6-41ae-8191-8c6b1c2faf19 None None] Found 1 cells: 43d564f7-5143-479a-991c-c11659f6272d {{(pid=50475) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 472.984454] nova-scheduler[50475]: DEBUG nova.scheduler.host_manager [None req-95576c08-f3b6-41ae-8191-8c6b1c2faf19 None None] Found 0 disabled cells: {{(pid=50475) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 473.015361] nova-scheduler[50475]: DEBUG nova.scheduler.host_manager [None req-95576c08-f3b6-41ae-8191-8c6b1c2faf19 None None] START:_async_init_instance_info {{(pid=50475) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 473.017135] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 473.017329] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 473.018671] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 473.026853] nova-scheduler[50475]: DEBUG oslo_db.sqlalchemy.engines [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50475) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 473.035474] nova-scheduler[50475]: DEBUG nova.scheduler.host_manager [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Total number of compute nodes: 0 {{(pid=50475) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 473.035814] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 473.036020] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 473.036184] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 473.089341] nova-scheduler[50475]: DEBUG nova.scheduler.host_manager [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] Adding 0 instances for hosts 10-20 {{(pid=50475) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 473.089580] nova-scheduler[50475]: DEBUG nova.scheduler.host_manager [None req-1a67f5df-b3b3-4508-88ff-3263f6bb7372 None None] END:_async_init_instance_info {{(pid=50475) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 473.112067] nova-scheduler[50475]: DEBUG nova.context [None req-95576c08-f3b6-41ae-8191-8c6b1c2faf19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43d564f7-5143-479a-991c-c11659f6272d(cell1) {{(pid=50475) load_cells /opt/stack/nova/nova/context.py:464}} [ 473.112067] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 473.112174] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 473.112844] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 473.113183] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 473.113367] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 473.113511] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50475) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 473.121115] nova-scheduler[50475]: DEBUG oslo_db.sqlalchemy.engines [None req-43740512-76bd-4174-838d-7d362cf2754e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50475) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 473.125976] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Acquiring lock "singleton_lock" {{(pid=50475) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 473.126148] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Acquired lock "singleton_lock" {{(pid=50475) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 473.126384] nova-scheduler[50475]: DEBUG oslo_concurrency.lockutils [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Releasing lock "singleton_lock" {{(pid=50475) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 473.126649] nova-scheduler[50475]: INFO oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Starting 2 workers [ 473.132117] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Started child 51486 {{(pid=50475) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 473.135025] nova-scheduler[51486]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 473.136505] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Started child 51488 {{(pid=50475) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 473.137106] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Full set of CONF: {{(pid=50475) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 473.137672] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ******************************************************************************** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 473.137672] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] Configuration options gathered from: {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 473.137672] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 473.137918] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] config files: ['/etc/nova/nova.conf'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 473.138056] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ================================================================================ {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 473.139031] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] allow_resize_to_same_host = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.139031] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] arq_binding_timeout = 300 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.139031] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] block_device_allocate_retries = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.139229] nova-scheduler[51488]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 473.139405] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] block_device_allocate_retries_interval = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.139405] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cert = self.pem {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.139462] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute_driver = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.140106] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute_monitors = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.140106] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] config_dir = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.140270] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] config_drive_format = iso9660 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.140270] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] config_file = ['/etc/nova/nova.conf'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.140479] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] config_source = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.140681] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] console_host = devstack {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141368] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] control_exchange = nova {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141368] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cpu_allocation_ratio = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141368] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] daemon = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141553] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] debug = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141599] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] default_access_ip_network_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141755] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] default_availability_zone = nova {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.141909] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] default_ephemeral_format = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.142791] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.142791] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] default_schedule_zone = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.142791] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] disk_allocation_ratio = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.142791] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] enable_new_services = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143115] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] enabled_apis = ['osapi_compute'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143115] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] enabled_ssl_apis = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143312] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] flat_injected = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143458] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] force_config_drive = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143942] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] force_raw_images = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143942] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] graceful_shutdown_timeout = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.143942] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] heal_instance_info_cache_interval = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.144485] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] host = devstack {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.144703] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] initial_cpu_allocation_ratio = 4.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.144883] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] initial_disk_allocation_ratio = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.145071] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] initial_ram_allocation_ratio = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.145329] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.145496] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_build_timeout = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146230] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_delete_interval = 300 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146230] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_format = [instance: %(uuid)s] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146230] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_name_template = instance-%08x {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146230] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_usage_audit = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146454] nova-scheduler[51486]: DEBUG oslo_db.sqlalchemy.engines [None req-03960e8a-3b2d-4d72-83dd-31dcf1e18823 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51486) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 473.146508] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_usage_audit_period = month {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146557] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146753] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] instances_path = /opt/stack/data/nova/instances {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.146932] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] internal_service_availability_zone = internal {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.147099] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] key = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.147251] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] live_migration_retry_count = 30 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.147428] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_config_append = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.147602] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.147779] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_dir = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.147946] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.148096] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_options = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.148278] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_rotate_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.148469] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_rotate_interval_type = days {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.148639] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] log_rotation_type = none {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.148805] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.148893] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.149068] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.149260] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.149387] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.149578] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] long_rpc_timeout = 1800 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.149736] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] max_concurrent_builds = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.149911] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] max_concurrent_live_migrations = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.150081] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] max_concurrent_snapshots = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.150271] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] max_local_block_devices = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.150464] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] max_logfile_count = 30 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151035] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] max_logfile_size_mb = 200 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151035] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] maximum_instance_delete_attempts = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151035] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metadata_listen = 0.0.0.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151212] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metadata_listen_port = 8775 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151363] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metadata_workers = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151518] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] migrate_max_retries = -1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151718] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] mkisofs_cmd = genisoimage {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.151837] nova-scheduler[51488]: DEBUG oslo_db.sqlalchemy.engines [None req-617fbb23-d8b8-4bf4-b366-2969f8d3d0fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51488) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 473.151904] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] my_block_storage_ip = 10.180.1.21 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.152039] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] my_ip = 10.180.1.21 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.152186] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] network_allocate_retries = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.152406] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.152576] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] osapi_compute_listen = 0.0.0.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.152763] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] osapi_compute_listen_port = 8774 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153133] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] osapi_compute_unique_server_name_scope = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153133] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] osapi_compute_workers = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153271] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] password_length = 12 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153605] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] periodic_enable = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153605] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] periodic_fuzzy_delay = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153770] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] pointer_model = usbtablet {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.153952] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] preallocate_images = none {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.154123] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] publish_errors = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.154238] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] pybasedir = /opt/stack/nova {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.154413] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ram_allocation_ratio = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.154586] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rate_limit_burst = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.154754] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rate_limit_except_level = CRITICAL {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.154911] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rate_limit_interval = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.155071] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reboot_timeout = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.155253] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reclaim_instance_interval = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.155424] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] record = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.155594] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reimage_timeout_per_gb = 20 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.155768] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] report_interval = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.155920] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rescue_timeout = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.156085] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reserved_host_cpus = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.156248] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reserved_host_disk_mb = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.156407] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reserved_host_memory_mb = 512 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.156584] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] reserved_huge_pages = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.156736] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] resize_confirm_window = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.156895] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] resize_fs_using_block_device = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.157061] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] resume_guests_state_on_host_boot = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.157250] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.157405] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] run_external_periodic_tasks = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.157578] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] running_deleted_instance_action = reap {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.157749] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] running_deleted_instance_poll_interval = 1800 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.157909] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] running_deleted_instance_timeout = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.158090] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler_instance_sync_interval = 120 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.158247] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_down_time = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.158437] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] servicegroup_driver = db {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159336] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] shelved_offload_time = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159336] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] shelved_poll_interval = 3600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159336] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] shutdown_timeout = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159336] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] source_is_ipv6 = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159336] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ssl_only = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159490] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] state_path = /opt/stack/data/nova {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159584] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] sync_power_state_interval = 600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159738] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] sync_power_state_pool_size = 1000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.159906] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] syslog_log_facility = LOG_USER {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.160072] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] tempdir = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.160236] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] timeout_nbd = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.160423] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] transport_url = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.160585] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] update_resources_interval = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.160758] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_cow_images = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.160916] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_eventlog = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.161079] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_journal = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.161231] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_json = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162085] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_rootwrap_daemon = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162085] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_stderr = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162085] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] use_syslog = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162085] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vcpu_pin_set = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162085] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vif_plugging_is_fatal = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162416] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vif_plugging_timeout = 300 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162416] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] virt_mkfs = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162576] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] volume_usage_poll_interval = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162743] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] watch_log_file = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.162918] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] web = /usr/share/spice-html5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 473.163216] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_concurrency.disable_process_locking = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.163429] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.163707] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.auth_strategy = keystone {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164100] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.compute_link_prefix = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164100] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164242] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.dhcp_domain = novalocal {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164412] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.enable_instance_password = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164574] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.glance_link_prefix = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164734] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.164924] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.165094] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.instance_list_per_project_cells = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.165251] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.list_records_by_skipping_down_cells = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.165434] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.local_metadata_per_cell = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.165636] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.max_limit = 1000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.165819] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.metadata_cache_expiration = 15 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.165996] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.neutron_default_tenant_id = default {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.166197] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.use_forwarded_for = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.166383] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.use_neutron_default_nets = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.166556] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.166714] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.166875] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.167059] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_dynamic_ssl_certfile = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.167254] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_dynamic_targets = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.167511] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_jsonfile_path = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.167582] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api.vendordata_providers = ['StaticJSON'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.167810] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.backend = dogpile.cache.memcached {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.167996] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.backend_argument = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.168201] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.config_prefix = cache.oslo {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.168385] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.dead_timeout = 60.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.168642] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.debug_cache_backend = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.168734] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.enable_retry_client = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.168900] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.enable_socket_keepalive = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.169094] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.enabled = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.169464] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.expiration_time = 600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.169464] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.hashclient_retry_attempts = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.169893] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.hashclient_retry_delay = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.169893] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_dead_retry = 300 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.170089] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_password = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.170420] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.170420] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.170572] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_pool_maxsize = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.170750] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.170916] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_sasl_enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.171109] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.171304] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_socket_timeout = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.memcache_username = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.proxies = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.retry_attempts = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.retry_delay = 0.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.socket_keepalive_count = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.socket_keepalive_idle = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.173835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.socket_keepalive_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.tls_allowed_ciphers = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.tls_cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.tls_certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.tls_enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cache.tls_keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.auth_type = password {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174321] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174321] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.catalog_info = volumev3::publicURL {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174321] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174321] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174430] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.cross_az_attach = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174916] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.debug = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174916] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.endpoint_template = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.174916] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.http_retries = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.175197] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.175197] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.175493] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.os_region_name = RegionOne {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.175526] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.175683] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cinder.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.175855] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176016] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.cpu_dedicated_set = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176172] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.cpu_shared_set = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176335] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.image_type_exclude_list = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176522] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176652] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.max_concurrent_disk_ops = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176804] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.max_disk_devices_to_attach = -1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.176960] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.177134] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.177291] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.resource_provider_association_refresh = 300 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.177512] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.shutdown_retry_interval = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.177832] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.177832] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] conductor.workers = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178202] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] console.allowed_origins = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178202] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] console.ssl_ciphers = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] console.ssl_minimum_version = default {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] consoleauth.token_ttl = 600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178675] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178827] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.178953] nova-scheduler[51486]: DEBUG nova.service [None req-03960e8a-3b2d-4d72-83dd-31dcf1e18823 None None] Creating RPC server for service scheduler {{(pid=51486) start /opt/stack/nova/nova/service.py:182}} [ 473.179040] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.179144] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.179325] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.179506] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.179626] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.179784] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.179936] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.180026] nova-scheduler[51488]: DEBUG nova.service [None req-617fbb23-d8b8-4bf4-b366-2969f8d3d0fd None None] Creating RPC server for service scheduler {{(pid=51488) start /opt/stack/nova/nova/service.py:182}} [ 473.180096] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.180250] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.region_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.180408] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.180571] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.service_type = accelerator {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.180742] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.180901] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.181071] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.181224] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.181401] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.181559] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] cyborg.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.181750] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.backend = sqlalchemy {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.181932] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.connection = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.182110] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.connection_debug = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.182277] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.connection_parameters = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.182460] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.connection_recycle_time = 3600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.182627] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.connection_trace = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.182793] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.db_inc_retry_interval = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.182971] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.db_max_retries = 20 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.183155] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.db_max_retry_interval = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.183320] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.db_retry_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.183530] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.max_overflow = 50 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.183695] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.max_pool_size = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.183893] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.max_retries = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.184067] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.mysql_enable_ndb = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.184237] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.184391] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.mysql_wsrep_sync_wait = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.184547] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.pool_timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.184709] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.retry_interval = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.184861] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.slave_connection = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.185032] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.sqlite_synchronous = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.185892] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] database.use_db_reconnect = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.185892] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.backend = sqlalchemy {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.185892] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.connection = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.185892] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.connection_debug = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.185892] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.connection_parameters = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.186069] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.connection_recycle_time = 3600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.186158] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.connection_trace = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.186313] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.db_inc_retry_interval = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.186822] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.db_max_retries = 20 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.186822] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.db_max_retry_interval = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.186822] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.db_retry_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.max_overflow = 50 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.max_pool_size = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.max_retries = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.mysql_enable_ndb = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187566] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187800] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.187852] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.pool_timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.188016] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.retry_interval = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.188171] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.slave_connection = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.188330] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] api_database.sqlite_synchronous = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.188526] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] devices.enabled_mdev_types = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.188700] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.188859] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ephemeral_storage_encryption.enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.189048] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.189234] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.api_servers = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.189407] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.189638] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.189770] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.189939] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.190108] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.190287] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.debug = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.190448] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.default_trusted_certificate_ids = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.190606] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.enable_certificate_validation = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.190791] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.enable_rbd_download = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.190945] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.191119] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.191282] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.191434] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.191585] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.191740] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.num_retries = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.191909] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.rbd_ceph_conf = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.192540] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.rbd_connect_timeout = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.192704] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.rbd_pool = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.192870] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.rbd_user = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.193041] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.region_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.193204] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.193390] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.service_type = image {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.193554] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194467] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194467] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194467] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194467] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194467] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.verify_glance_signatures = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194747] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] glance.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194747] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] guestfs.debug = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.194853] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.config_drive_cdrom = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.195016] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.config_drive_inject_password = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.195186] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.195350] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.enable_instance_metrics_collection = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.195608] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.enable_remotefx = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.195712] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.instances_path_share = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.195875] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.iscsi_initiator_list = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.196044] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.limit_cpu_features = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.196207] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.196368] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.196524] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.power_state_check_timeframe = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.196681] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.196845] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.197010] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.use_multipath_io = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.197178] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.volume_attach_retry_count = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.197332] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.197487] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.vswitch_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.197665] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.197858] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] mks.enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.198505] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.198727] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] image_cache.manager_interval = 2400 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.198898] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] image_cache.precache_concurrency = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.199078] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] image_cache.remove_unused_base_images = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.199248] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.199409] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.199599] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] image_cache.subdirectory_name = _base {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.199792] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.api_max_retries = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.199951] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.api_retry_interval = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.200118] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.200282] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.auth_type = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.200435] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.200636] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.200808] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201151] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201151] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201317] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201785] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201785] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201785] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.201936] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.202051] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.partition_key = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.202216] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.peer_list = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.202390] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.region_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.202564] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.serial_console_state_timeout = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.202720] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.202905] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.service_type = baremetal {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.203094] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.203297] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.203442] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.203606] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.203784] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.203940] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ironic.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.204154] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.204350] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] key_manager.fixed_key = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.204569] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.204729] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.barbican_api_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205533] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.barbican_endpoint = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205533] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.barbican_endpoint_type = public {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205533] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.barbican_region_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205533] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205675] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205758] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.205875] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.206032] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.206233] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.number_of_retries = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.206366] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.retry_delay = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.206540] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.send_service_user_token = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.206712] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.206866] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.207031] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.verify_ssl = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.207192] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican.verify_ssl_path = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.207358] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.207591] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.auth_type = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.207742] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.207896] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.208066] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.208245] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.208373] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.208546] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.208693] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] barbican_service_user.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.208871] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.approle_role_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209038] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.approle_secret_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209200] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209346] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209510] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209653] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209804] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.209984] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.kv_mountpoint = secret {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.210190] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.kv_version = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.210320] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.namespace = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.210474] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.root_token_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.210729] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.210985] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.ssl_ca_crt_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.211185] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.211364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.use_ssl = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.211543] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.211609] nova-scheduler[51488]: DEBUG nova.service [None req-617fbb23-d8b8-4bf4-b366-2969f8d3d0fd None None] Join ServiceGroup membership for this service scheduler {{(pid=51488) start /opt/stack/nova/nova/service.py:199}} [ 473.211733] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.211847] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-617fbb23-d8b8-4bf4-b366-2969f8d3d0fd None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51488) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 473.211902] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212075] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212439] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212439] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212574] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212796] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212881] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.212927] nova-scheduler[51486]: DEBUG nova.service [None req-03960e8a-3b2d-4d72-83dd-31dcf1e18823 None None] Join ServiceGroup membership for this service scheduler {{(pid=51486) start /opt/stack/nova/nova/service.py:199}} [ 473.213042] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.213167] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-03960e8a-3b2d-4d72-83dd-31dcf1e18823 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51486) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 473.213201] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.213355] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.region_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.213518] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.213682] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.service_type = identity {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.213837] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.213989] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.214161] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.214315] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.214488] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.214642] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] keystone.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.214877] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.connection_uri = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.215064] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_mode = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.215229] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_model_extra_flags = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.215388] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_models = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.215552] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_power_governor_high = performance {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.215713] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_power_governor_low = powersave {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.215867] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_power_management = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.216056] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.216239] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.device_detach_attempts = 8 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.216395] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.device_detach_timeout = 20 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.216552] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.disk_cachemodes = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.216703] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.disk_prefix = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.216863] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.enabled_perf_events = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.217026] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.file_backed_memory = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.217186] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.gid_maps = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.217364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.hw_disk_discard = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.217518] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.hw_machine_type = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.217678] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_rbd_ceph_conf = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.217830] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218022] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218245] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_rbd_glance_store_name = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218398] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_rbd_pool = rbd {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218506] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_type = default {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218652] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.images_volume_group = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218810] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.inject_key = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.218961] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.inject_partition = -2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.219124] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.inject_password = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.219277] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.iscsi_iface = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.219577] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.iser_use_multipath = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.219621] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_bandwidth = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.219744] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.219935] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_downtime = 500 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.220074] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.220231] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.220387] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_inbound_addr = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.220539] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.220693] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_permit_post_copy = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.220868] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_scheme = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.221054] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_timeout_action = abort {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.221219] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_tunnelled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.221374] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_uri = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.221534] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.live_migration_with_native_tls = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.221715] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.max_queues = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.221878] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.222068] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.nfs_mount_options = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.222322] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.222516] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.222678] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.num_iser_scan_tries = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.222829] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.num_memory_encrypted_guests = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.222983] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.223166] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.num_pcie_ports = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.223344] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.num_volume_scan_tries = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.223514] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.pmem_namespaces = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.223669] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.quobyte_client_cfg = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.223916] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.224089] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rbd_connect_timeout = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.224249] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.224415] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.224573] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rbd_secret_uuid = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.224729] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rbd_user = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.224883] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.225069] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.remote_filesystem_transport = ssh {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.225233] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rescue_image_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.225410] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rescue_kernel_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.225591] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rescue_ramdisk_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.225766] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rng_dev_path = /dev/urandom {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.225921] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.rx_queue_size = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.226099] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.smbfs_mount_options = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.226323] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.226485] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.snapshot_compression = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.snapshot_image_format = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.sparse_logical_volumes = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.swtpm_enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227364] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.swtpm_group = tss {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227544] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.swtpm_user = tss {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227623] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.sysinfo_serial = unique {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227773] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.tx_queue_size = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.227980] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.uid_maps = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.228152] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.use_virtio_for_bridges = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.228313] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.virt_type = kvm {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.228531] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.volume_clear = zero {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.228632] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.volume_clear_size = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.228790] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.volume_use_multipath = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.228941] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_cache_path = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.229114] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.229273] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_mount_group = qemu {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.229429] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_mount_opts = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.229591] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.229801] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.229966] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.vzstorage_mount_user = stack {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.230135] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.230303] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.230470] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.auth_type = password {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.230625] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.230774] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.230956] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.231305] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.231305] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.231467] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.default_floating_pool = public {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.231625] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.231782] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.extension_sync_interval = 600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.231937] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.http_retries = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.232107] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.232262] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.232445] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.232619] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.232774] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.232945] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.ovs_bridge = br-int {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.233115] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.physnets = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.233280] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.region_name = RegionOne {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.233479] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.service_metadata_proxy = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.233640] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.233809] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.service_type = network {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.233964] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.234133] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.234289] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.234442] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.234616] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.234781] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] neutron.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.234946] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] notifications.bdms_in_notifications = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.235132] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] notifications.default_level = INFO {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.235300] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] notifications.notification_format = unversioned {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.235488] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] notifications.notify_on_state_change = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.235702] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.235891] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] pci.alias = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.236733] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] pci.device_spec = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.236733] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] pci.report_in_placement = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.236733] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.236733] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.auth_type = password {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.236919] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.auth_url = http://10.180.1.21/identity {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.236985] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.237146] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.237306] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.237459] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.237611] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.237768] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.default_domain_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.237921] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.default_domain_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.238082] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.domain_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.238384] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.domain_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.238384] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.238531] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.238713] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.238922] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.239096] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.239263] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.password = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.239416] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.project_domain_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.239580] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.project_domain_name = Default {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.239764] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.project_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.239936] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.project_name = service {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.240113] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.region_name = RegionOne {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.240270] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.240440] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.service_type = placement {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.240608] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.240767] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.240918] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.241080] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.system_scope = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.241231] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.241381] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.trust_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.241545] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.user_domain_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.241711] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.user_domain_name = Default {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.241865] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.user_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.242048] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.username = placement {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.242228] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.242405] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] placement.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.242595] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.cores = 20 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.242926] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.count_usage_from_placement = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.242926] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.243092] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.injected_file_content_bytes = 10240 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.243455] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.injected_file_path_length = 255 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.243455] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.injected_files = 5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.243583] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.instances = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.243748] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.key_pairs = 100 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.243913] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.metadata_items = 128 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.244083] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.ram = 51200 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.244245] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.recheck_quota = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.244404] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.server_group_members = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.244578] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] quota.server_groups = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.244724] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rdp.enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.245103] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.245327] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.245522] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.245705] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.image_metadata_prefilter = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.245874] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.246063] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.max_attempts = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.246229] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.max_placement_results = 1000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.246389] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.246542] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.query_placement_for_availability_zone = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.246718] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.query_placement_for_image_type_support = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.246873] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.247069] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] scheduler.workers = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.247271] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.247441] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.247645] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.247831] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.248062] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.248262] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.248448] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.248664] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.248835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.host_subset_size = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.248990] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.249168] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.249338] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.isolated_hosts = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.249501] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.isolated_images = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.249658] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.249832] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.249990] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.pci_in_placement = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.250169] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.250328] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.250557] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.250739] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.250900] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.251143] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.251310] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.track_instance_changes = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.251486] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.251678] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metrics.required = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.251838] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metrics.weight_multiplier = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.251997] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metrics.weight_of_unavailable = -10000.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.252170] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] metrics.weight_setting = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.252490] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.252667] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] serial_console.enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.252851] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] serial_console.port_range = 10000:20000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.253027] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.253305] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.253373] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] serial_console.serialproxy_port = 6083 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.253657] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.253741] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.auth_type = password {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.253898] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.254060] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.254221] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.254404] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.254559] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.254725] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.send_service_user_token = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.254896] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.255069] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] service_user.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.255241] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.agent_enabled = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.255425] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.255813] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.256043] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.html5proxy_host = 0.0.0.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.256221] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.html5proxy_port = 6082 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.256380] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.image_compression = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.256553] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.jpeg_compression = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.256708] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.playback_compression = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.256878] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.server_listen = 127.0.0.1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.257088] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.257248] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.streaming_mode = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.257400] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] spice.zlib_compression = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.257585] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] upgrade_levels.baseapi = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.257740] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] upgrade_levels.cert = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.257903] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] upgrade_levels.compute = auto {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.258068] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] upgrade_levels.conductor = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.258222] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] upgrade_levels.scheduler = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.258402] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.258562] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.auth_type = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.258786] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.258965] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.259135] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.259294] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.259452] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.259608] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.259759] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vendordata_dynamic_auth.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.259971] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.api_retry_count = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.260140] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.ca_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.260483] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.cache_prefix = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.260483] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.cluster_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.260613] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.connection_pool_size = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.260830] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.console_delay_seconds = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.260911] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.datastore_regex = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.261087] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.host_ip = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.261241] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.host_password = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.261397] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.host_port = 443 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.261548] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.host_username = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.261702] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.261850] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.integration_bridge = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.262008] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.maximum_objects = 100 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.262162] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.pbm_default_policy = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.262315] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.pbm_enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.262514] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.pbm_wsdl_location = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.262695] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.262852] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.serial_port_proxy_uri = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.263026] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.serial_port_service_uri = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.263178] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.task_poll_interval = 0.5 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.263335] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.use_linked_clone = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.263498] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.vnc_keymap = en-us {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.263656] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.vnc_port = 5900 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.263811] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vmware.vnc_port_total = 10000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.264008] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.auth_schemes = ['none'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.264177] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.enabled = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.264497] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.264680] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.264844] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.novncproxy_port = 6080 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.265033] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.server_listen = 127.0.0.1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.265210] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.265368] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.vencrypt_ca_certs = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.265667] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.vencrypt_client_cert = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.265667] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] vnc.vencrypt_client_key = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.265881] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.266052] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.disable_deep_image_inspection = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.266219] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.266379] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.disable_group_policy_check_upcall = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.266535] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.266689] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.disable_rootwrap = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.266868] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.enable_numa_live_migration = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267037] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267198] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267353] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267509] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.libvirt_disable_apic = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267660] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267819] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.267975] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.268141] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.268319] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269030] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269030] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269030] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269030] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269169] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269267] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269436] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.client_socket_timeout = 900 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269593] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.default_pool_size = 1000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269757] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.keep_alive = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.269915] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.max_header_line = 16384 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.270081] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.secure_proxy_ssl_header = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.270241] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.ssl_ca_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.270425] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.ssl_cert_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.270595] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.ssl_key_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.270756] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.tcp_keepidle = 600 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271470] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271470] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] zvm.ca_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271470] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] zvm.cloud_connector_url = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271470] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271728] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] zvm.reachable_timeout = 300 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271804] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.271968] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.272143] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.272307] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.272493] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.272713] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.enforce_new_defaults = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.272903] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.enforce_scope = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.273086] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.policy_default_rule = default {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.273282] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.273449] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.policy_file = policy.yaml {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.273631] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.273835] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.274063] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.274230] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.274390] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.274583] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.274760] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.274964] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.connection_string = messaging:// {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.275143] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.enabled = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.275325] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.es_doc_type = notification {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.275500] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.es_scroll_size = 10000 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.275665] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.es_scroll_time = 2m {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.275819] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.filter_error_trace = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.275981] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.hmac_keys = SECRET_KEY {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.276147] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.sentinel_service_name = mymaster {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.276311] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.socket_timeout = 0.1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.276466] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] profiler.trace_sqlalchemy = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.276634] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] remote_debug.host = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.276786] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] remote_debug.port = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.277036] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.277237] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.277412] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.277568] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.277731] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.277886] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.278058] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.278217] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.278375] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.278530] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.278703] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.278872] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.279053] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.279217] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.279374] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.279547] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.279705] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.279862] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.280178] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.280273] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.280460] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.280625] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.280784] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.280945] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.281122] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.281287] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.ssl = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.281454] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.281620] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.281773] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.281940] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.282111] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_rabbit.ssl_version = {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.282321] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.282530] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_notifications.retry = -1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.282743] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.282915] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_messaging_notifications.transport_url = **** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.283126] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.auth_section = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.283294] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.auth_type = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.283465] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.cafile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.283635] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.certfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.283795] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.collect_timing = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.283947] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.connect_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.284112] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.connect_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.284288] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.endpoint_id = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.284447] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.endpoint_override = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.284775] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.insecure = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.284775] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.keyfile = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.284878] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.max_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285558] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.min_version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285558] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.region_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285558] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.service_name = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285558] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.service_type = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285668] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.split_loggers = False {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285972] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.status_code_retries = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.285972] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.status_code_retry_delay = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.286134] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.timeout = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.286261] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.valid_interfaces = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.286423] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_limit.version = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.286628] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_reports.file_event_handler = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.286798] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.286957] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] oslo_reports.log_dir = None {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 473.287098] nova-scheduler[50475]: DEBUG oslo_service.service [None req-43740512-76bd-4174-838d-7d362cf2754e None None] ******************************************************************************** {{(pid=50475) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 607.358396] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Starting to schedule for instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 607.359090] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 607.359280] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.359566] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.359879] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.360320] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 607.529154] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.530292] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.531959] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.536996] nova-scheduler[51488]: DEBUG oslo_db.sqlalchemy.engines [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51488) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 607.557840] nova-scheduler[51488]: DEBUG oslo_db.sqlalchemy.engines [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Parent process 50475 forked (51488) with an open database connection, which is being discarded and recreated. {{(pid=51488) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 607.565701] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.565701] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.565701] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.578289] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.578589] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.579842] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:45:20Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 607.581467] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 607.581682] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 607.581874] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 607.582950] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.004s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.583409] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 607.584173] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.584173] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.586060] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.586060] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.586060] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.586060] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.586205] nova-scheduler[51488]: DEBUG nova.filters [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.586383] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 607.586684] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 607.586960] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Attempting to claim resources in the placement API for instance 8b13a5ee-6538-4eb9-9ae6-b3a960a958f2 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 607.613884] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Starting to schedule for instances: ['f42f768c-09ad-44b6-b294-681f392bb483'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 607.615763] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 607.615763] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.615763] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.615763] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.616041] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 607.679890] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] [instance: 8b13a5ee-6538-4eb9-9ae6-b3a960a958f2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 607.680148] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.680242] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.680471] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ad1f4f1e-c5b5-4af2-9dcf-668c5ccb84cf tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.685051] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.685051] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.687201] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.690460] nova-scheduler[51486]: DEBUG oslo_db.sqlalchemy.engines [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51486) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 607.710780] nova-scheduler[51486]: DEBUG oslo_db.sqlalchemy.engines [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Parent process 50475 forked (51486) with an open database connection, which is being discarded and recreated. {{(pid=51486) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 607.726559] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.727033] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.727619] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.738257] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.738257] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.742886] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:45:20Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 607.742886] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 607.743084] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 607.743084] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 607.743084] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.743484] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 607.743838] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.744126] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.744466] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.744717] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.745049] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.745248] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.745509] nova-scheduler[51486]: DEBUG nova.filters [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 607.745742] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 607.746070] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 607.746372] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Attempting to claim resources in the placement API for instance f42f768c-09ad-44b6-b294-681f392bb483 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 607.821046] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] [instance: f42f768c-09ad-44b6-b294-681f392bb483] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 607.821046] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.821276] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.821328] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-110abea0-59f5-4dcf-8b58-430bf3044949 tempest-ServerDiagnosticsNegativeTest-350562321 tempest-ServerDiagnosticsNegativeTest-350562321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.083645] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Starting to schedule for instances: ['c4837d87-be47-4a47-9703-f73eeddb0053'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 609.083645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 609.083645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.083645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.083645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.083964] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 609.137144] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.137387] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.137536] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.145549] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.145808] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.146026] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.152291] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.152401] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.152976] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 609.153136] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 609.153249] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 609.153595] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 609.153595] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.154118] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 609.154357] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.154591] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.154777] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.155083] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.155599] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.155854] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.156068] nova-scheduler[51488]: DEBUG nova.filters [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.156211] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 609.156730] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 609.156965] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Attempting to claim resources in the placement API for instance c4837d87-be47-4a47-9703-f73eeddb0053 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 609.218813] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] [instance: c4837d87-be47-4a47-9703-f73eeddb0053] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 609.220783] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.220783] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.220783] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00e7fe48-33d0-4189-8cac-e50a02e11e2d tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.512922] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Starting to schedule for instances: ['0f052eb8-59d7-4dcb-9d2f-bc7740424a66'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 609.513969] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 609.513969] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.513969] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.516177] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.516415] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 609.574974] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.575095] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.575203] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.590078] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.590311] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.590519] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.592865] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.593389] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.593534] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 609.596250] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 609.596250] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 609.596250] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 609.597097] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 609.597097] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 609.597097] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597097] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597471] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597471] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597471] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597471] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597471] nova-scheduler[51486]: DEBUG nova.filters [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 609.597612] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 609.597612] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 609.597612] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Attempting to claim resources in the placement API for instance 0f052eb8-59d7-4dcb-9d2f-bc7740424a66 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 609.676370] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] [instance: 0f052eb8-59d7-4dcb-9d2f-bc7740424a66] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 609.676843] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 609.676931] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 609.677114] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-78ffdc23-194c-4ad7-a295-19e4795469cc tempest-FloatingIPsAssociationNegativeTestJSON-1832406944 tempest-FloatingIPsAssociationNegativeTestJSON-1832406944-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.270565] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Starting to schedule for instances: ['734b416a-659c-451b-82ea-0b8a2796fffd'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 613.270781] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 613.271393] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.271588] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.271850] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.272055] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 613.335720] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.336162] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.336162] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.344862] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.345311] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.349073] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.349073] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.349073] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.349257] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='0',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:03Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 613.349257] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-16T19:46:01Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-585673929',updated_at=None,uuid=6e0fa9d6-4404-4f9b-bc52-c71a4c8e2c0f)] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 613.349369] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 613.349424] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 613.349549] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.350164] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 613.350379] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.350559] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.350754] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.351011] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.351213] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.351378] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.351610] nova-scheduler[51488]: DEBUG nova.filters [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.351819] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 613.352031] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 613.352194] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Attempting to claim resources in the placement API for instance 734b416a-659c-451b-82ea-0b8a2796fffd {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 613.423753] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] [instance: 734b416a-659c-451b-82ea-0b8a2796fffd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 613.424075] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.424707] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.424849] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-63bcbf14-9acb-489d-a5ba-ae97bee82d0d tempest-ServersTestManualDisk-123449131 tempest-ServersTestManualDisk-123449131-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.236218] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Starting to schedule for instances: ['4a6f2391-5c17-452d-baf2-c4c62a2dde72'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 616.236218] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 616.236218] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.236218] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.236218] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.236880] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 616.291634] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.291634] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.291861] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.299650] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.299881] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.300057] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.302708] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.302908] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.303367] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='0',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:07Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=5) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 616.303572] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 616.303955] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 616.303955] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 616.304116] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.304332] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 616.304527] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.304701] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.304890] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.305060] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.305217] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.305371] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.305632] nova-scheduler[51486]: DEBUG nova.filters [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 616.305873] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 616.305948] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 616.306219] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Attempting to claim resources in the placement API for instance 4a6f2391-5c17-452d-baf2-c4c62a2dde72 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 616.382730] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] [instance: 4a6f2391-5c17-452d-baf2-c4c62a2dde72] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 616.383019] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.383230] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.383426] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-6b8460d3-9b3c-4449-9a5b-f879c70ff2d5 tempest-ServerExternalEventsTest-1961432341 tempest-ServerExternalEventsTest-1961432341-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.250685] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Starting to schedule for instances: ['533ba77f-7191-4af2-b3c7-204efa001ffa'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 618.251923] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 618.252151] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.252685] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.252963] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.253175] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 618.307320] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.307558] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.307726] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.317172] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.317741] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.317741] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.320101] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.320434] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.320756] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='0',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_138039fed4eb4e17a4d7c396fc58e157='1',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:10Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 618.320944] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 618.321128] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 618.321284] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd', '4a6f2391-5c17-452d-baf2-c4c62a2dde72'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 618.321447] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.321727] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 618.321933] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.322129] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.322580] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.322580] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.322720] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.322794] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.322950] nova-scheduler[51488]: DEBUG nova.filters [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.323129] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 618.323300] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 618.323477] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Attempting to claim resources in the placement API for instance 533ba77f-7191-4af2-b3c7-204efa001ffa {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 618.387146] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] [instance: 533ba77f-7191-4af2-b3c7-204efa001ffa] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 618.387460] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.387668] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.388321] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e877e246-ef14-4679-8dff-87af11337d4d tempest-ServerDiagnosticsTest-268993674 tempest-ServerDiagnosticsTest-268993674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.409094] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Starting to schedule for instances: ['e105adff-476c-46b0-b795-daf44b69ef3a'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 620.409094] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 620.409334] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.409856] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.410148] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.410400] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 620.455910] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.456212] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.456273] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.462912] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.464055] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.464055] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.465483] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.465643] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.466023] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_138039fed4eb4e17a4d7c396fc58e157='1',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_cc065469898443b8ab77b8a7b07f39b2='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_networking='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:13Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=7) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 620.466297] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 620.466463] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 620.466618] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd', '4a6f2391-5c17-452d-baf2-c4c62a2dde72', '533ba77f-7191-4af2-b3c7-204efa001ffa'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 620.466778] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.467049] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 620.467237] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.467412] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.467603] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.467784] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.467917] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.468104] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.468257] nova-scheduler[51486]: DEBUG nova.filters [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.468400] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 620.468563] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 620.468735] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Attempting to claim resources in the placement API for instance e105adff-476c-46b0-b795-daf44b69ef3a {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 620.526175] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] [instance: e105adff-476c-46b0-b795-daf44b69ef3a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 620.526442] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.526653] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.526929] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dab7f34a-f06e-4470-834c-72aa23df9b69 tempest-ServerActionsTestOtherB-998771733 tempest-ServerActionsTestOtherB-998771733-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.003162] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Starting to schedule for instances: ['62cecc37-ce9f-42f6-8be2-efa724e94916'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 622.005345] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 622.005742] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.005991] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.006219] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.006422] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 622.055308] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.055952] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.057455] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.067589] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.067865] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.067978] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.070726] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.070928] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.071435] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_138039fed4eb4e17a4d7c396fc58e157='1',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_69230e047a304d339209621a4da6d72e='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_cc065469898443b8ab77b8a7b07f39b2='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='1',num_task_networking='1',num_task_spawning='6',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=8) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 622.071782] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 622.071967] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 622.072149] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd', '4a6f2391-5c17-452d-baf2-c4c62a2dde72', '533ba77f-7191-4af2-b3c7-204efa001ffa', 'e105adff-476c-46b0-b795-daf44b69ef3a'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 622.072328] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.072590] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 622.072808] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.073348] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.073348] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.073451] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.073597] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.073747] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.073873] nova-scheduler[51488]: DEBUG nova.filters [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 622.074293] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 622.074872] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 622.074872] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Attempting to claim resources in the placement API for instance 62cecc37-ce9f-42f6-8be2-efa724e94916 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 622.138363] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] [instance: 62cecc37-ce9f-42f6-8be2-efa724e94916] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 622.141951] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.141951] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.141951] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-62ee8e35-60b3-423b-be73-b8bea77860df tempest-ServersAdminNegativeTestJSON-259660287 tempest-ServersAdminNegativeTestJSON-259660287-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.637706] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Starting to schedule for instances: ['89c6b8db-b87a-4a05-9fab-72eff91e4fe3'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 623.638029] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 623.638198] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.638379] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.638574] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.638751] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 623.682512] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.682740] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.683121] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.689467] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.689668] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.689993] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.692189] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.692391] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.692801] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='0',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_138039fed4eb4e17a4d7c396fc58e157='1',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_57aecfe513b64d13971574d0920a47e7='1',num_proj_69230e047a304d339209621a4da6d72e='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_cc065469898443b8ab77b8a7b07f39b2='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='2',num_task_networking='1',num_task_spawning='6',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:16Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=9) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 623.693032] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 623.693205] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 623.693362] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd', '4a6f2391-5c17-452d-baf2-c4c62a2dde72', '533ba77f-7191-4af2-b3c7-204efa001ffa', 'e105adff-476c-46b0-b795-daf44b69ef3a', '62cecc37-ce9f-42f6-8be2-efa724e94916'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 623.693521] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.693850] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 623.694008] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.694201] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.694799] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.694799] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.694799] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.694930] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.695058] nova-scheduler[51486]: DEBUG nova.filters [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 623.695491] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 623.695695] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 623.695878] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Attempting to claim resources in the placement API for instance 89c6b8db-b87a-4a05-9fab-72eff91e4fe3 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 623.752185] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] [instance: 89c6b8db-b87a-4a05-9fab-72eff91e4fe3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 623.752495] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.752704] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.752901] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-bb040803-b257-4d0a-b376-2fbcaca148fd tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.282577] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Starting to schedule for instances: ['58622c1f-054c-454b-a288-f544fe883157'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 626.283145] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 626.283145] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 626.283446] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 626.283867] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 626.284138] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 626.336825] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.337067] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.337240] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.344536] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.344668] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.344768] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.347143] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.347356] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.347838] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_138039fed4eb4e17a4d7c396fc58e157='1',num_proj_26daced2efba4563aad36c2b98b1cc85='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='1',num_proj_57aecfe513b64d13971574d0920a47e7='1',num_proj_69230e047a304d339209621a4da6d72e='1',num_proj_88bd5475f9aa4c0db831466e666607ad='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_cc065469898443b8ab77b8a7b07f39b2='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='1',num_task_None='3',num_task_networking='1',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:18Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=10) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 626.348456] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 626.348456] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 626.348456] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with instances: ['8b13a5ee-6538-4eb9-9ae6-b3a960a958f2', 'f42f768c-09ad-44b6-b294-681f392bb483', 'c4837d87-be47-4a47-9703-f73eeddb0053', '0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd', '4a6f2391-5c17-452d-baf2-c4c62a2dde72', '533ba77f-7191-4af2-b3c7-204efa001ffa', 'e105adff-476c-46b0-b795-daf44b69ef3a', '62cecc37-ce9f-42f6-8be2-efa724e94916', '89c6b8db-b87a-4a05-9fab-72eff91e4fe3'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 626.348661] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.349191] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 626.349191] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.349552] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.349800] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.353423] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.353423] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.353423] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.353423] nova-scheduler[51488]: DEBUG nova.filters [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.353423] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 626.353635] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 626.353635] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Attempting to claim resources in the placement API for instance 58622c1f-054c-454b-a288-f544fe883157 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 626.421717] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] [instance: 58622c1f-054c-454b-a288-f544fe883157] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 626.421717] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.421717] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.421869] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-cff2793b-c043-4043-ab00-b6207da6a7b2 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.908909] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Starting to schedule for instances: ['75688c3f-b100-45f6-88ef-3316d8185f89'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.908909] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.908909] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.908909] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.908909] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.909358] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.971911] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.973041] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.973240] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.985445] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.985712] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.985872] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.988856] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.989051] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.989427] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_138039fed4eb4e17a4d7c396fc58e157='1',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='1',num_proj_69230e047a304d339209621a4da6d72e='1',num_proj_88bd5475f9aa4c0db831466e666607ad='1',num_proj_c151ec284e644559b18bf267868e96ef='1',num_proj_cc065469898443b8ab77b8a7b07f39b2='1',num_proj_f35535d2e68e42dd87b1629dc319e460='1',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='3',num_task_networking='1',num_task_spawning='3',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:21Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=7) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.989717] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.989886] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.990072] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Update host state with instances: ['0f052eb8-59d7-4dcb-9d2f-bc7740424a66', '734b416a-659c-451b-82ea-0b8a2796fffd', '4a6f2391-5c17-452d-baf2-c4c62a2dde72', '533ba77f-7191-4af2-b3c7-204efa001ffa', 'e105adff-476c-46b0-b795-daf44b69ef3a', '62cecc37-ce9f-42f6-8be2-efa724e94916', '89c6b8db-b87a-4a05-9fab-72eff91e4fe3', '58622c1f-054c-454b-a288-f544fe883157'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.990654] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.990979] nova-scheduler[51486]: DEBUG nova.filters [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.992233] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 60.839364 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 627.992470] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 627.992649] nova-scheduler[51486]: INFO nova.filters [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Filter ComputeFilter returned 0 hosts [ 627.992825] nova-scheduler[51486]: DEBUG nova.filters [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Filtering removed all hosts for the request with instance ID '75688c3f-b100-45f6-88ef-3316d8185f89'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 627.992994] nova-scheduler[51486]: INFO nova.filters [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Filtering removed all hosts for the request with instance ID '75688c3f-b100-45f6-88ef-3316d8185f89'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 627.993814] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.994025] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-23b69850-d073-45e2-a76f-ece1b1ddf120 tempest-TenantUsagesTestJSON-766825191 tempest-TenantUsagesTestJSON-766825191-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 632.935935] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Starting to schedule for instances: ['90bd55c2-b3a3-4476-933d-1f84856dd374'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 632.936236] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 632.936393] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 632.938584] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 632.938855] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 632.939065] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 632.999771] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.999991] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.001469] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.012548] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.012761] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.012922] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.017472] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.017641] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.018046] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='5',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='1',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='1',num_proj_69230e047a304d339209621a4da6d72e='1',num_proj_88bd5475f9aa4c0db831466e666607ad='1',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='1',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='4',num_task_networking='1',num_task_spawning='0',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:26Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=5) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 633.018336] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 633.018500] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 633.018651] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Update host state with instances: ['533ba77f-7191-4af2-b3c7-204efa001ffa', 'e105adff-476c-46b0-b795-daf44b69ef3a', '62cecc37-ce9f-42f6-8be2-efa724e94916', '89c6b8db-b87a-4a05-9fab-72eff91e4fe3', '58622c1f-054c-454b-a288-f544fe883157'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 633.018808] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.019081] nova-scheduler[51488]: DEBUG nova.filters [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 633.019321] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 65.867457 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 633.019499] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 633.019657] nova-scheduler[51488]: INFO nova.filters [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filter ComputeFilter returned 0 hosts [ 633.019822] nova-scheduler[51488]: DEBUG nova.filters [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filtering removed all hosts for the request with instance ID '90bd55c2-b3a3-4476-933d-1f84856dd374'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 633.019965] nova-scheduler[51488]: INFO nova.filters [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filtering removed all hosts for the request with instance ID '90bd55c2-b3a3-4476-933d-1f84856dd374'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 633.020129] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 633.020272] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e9835e25-a35f-4e70-bb10-9669651e6f64 tempest-ServerRescueNegativeTestJSON-1101508799 tempest-ServerRescueNegativeTestJSON-1101508799-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 637.144234] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Starting to schedule for instances: ['491e0bb0-af3e-45fc-b17e-2c7bf1946a0f'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 637.144234] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 637.144635] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.144837] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.147446] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.147446] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 637.198196] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.198952] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.198952] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.206495] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.207339] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.207339] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.209242] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.209438] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.209824] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 637.210114] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 637.210385] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 637.213806] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 637.214039] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.214320] nova-scheduler[51486]: DEBUG nova.filters [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 637.214531] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 70.0627 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 637.214701] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 637.214864] nova-scheduler[51486]: INFO nova.filters [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filter ComputeFilter returned 0 hosts [ 637.215020] nova-scheduler[51486]: DEBUG nova.filters [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filtering removed all hosts for the request with instance ID '491e0bb0-af3e-45fc-b17e-2c7bf1946a0f'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 637.215157] nova-scheduler[51486]: INFO nova.filters [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filtering removed all hosts for the request with instance ID '491e0bb0-af3e-45fc-b17e-2c7bf1946a0f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 637.215301] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 637.215616] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e450ffce-2af5-4ba5-9560-c2bda6e47cff tempest-DeleteServersAdminTestJSON-500150000 tempest-DeleteServersAdminTestJSON-500150000-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 637.412356] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Starting to schedule for instances: ['b8804093-83e2-4e28-ba2d-c33af1dfbf7a'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 637.412356] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 637.416581] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.416868] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.417098] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.417289] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 637.467285] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.467531] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.467702] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.476485] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.476630] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.476796] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.482280] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.482280] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.482740] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 637.483572] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 637.483572] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 637.483785] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 637.483851] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.484169] nova-scheduler[51488]: DEBUG nova.filters [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 637.484467] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 70.332553 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 637.484960] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 637.484960] nova-scheduler[51488]: INFO nova.filters [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Filter ComputeFilter returned 0 hosts [ 637.486074] nova-scheduler[51488]: DEBUG nova.filters [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Filtering removed all hosts for the request with instance ID 'b8804093-83e2-4e28-ba2d-c33af1dfbf7a'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 637.486074] nova-scheduler[51488]: INFO nova.filters [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Filtering removed all hosts for the request with instance ID 'b8804093-83e2-4e28-ba2d-c33af1dfbf7a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 637.486074] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 637.486074] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6e41a182-7bef-49b4-ba9d-45059c2741ed tempest-FloatingIPsAssociationTestJSON-1263641007 tempest-FloatingIPsAssociationTestJSON-1263641007-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 639.044699] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Starting to schedule for instances: ['c456969d-a960-4e7f-9bab-ddcd0aac9a27'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 639.045224] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 639.045224] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.045405] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.045734] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.045734] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 639.092899] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.093481] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.093481] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.104116] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.104338] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.105291] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.107089] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.107286] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.107632] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 639.107928] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 639.108146] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 639.108296] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 639.108548] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.108852] nova-scheduler[51486]: DEBUG nova.filters [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 639.109079] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 71.957234 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 639.109251] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 639.109414] nova-scheduler[51486]: INFO nova.filters [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Filter ComputeFilter returned 0 hosts [ 639.109592] nova-scheduler[51486]: DEBUG nova.filters [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Filtering removed all hosts for the request with instance ID 'c456969d-a960-4e7f-9bab-ddcd0aac9a27'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 639.109695] nova-scheduler[51486]: INFO nova.filters [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Filtering removed all hosts for the request with instance ID 'c456969d-a960-4e7f-9bab-ddcd0aac9a27'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 639.110379] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 639.110379] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be0dc1e-1b44-450d-a196-fc0e4e152965 tempest-ServersAdmin275Test-662689062 tempest-ServersAdmin275Test-662689062-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 639.297369] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Starting to schedule for instances: ['3028cdf7-9f75-4885-890b-674fa5d8fb8e'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 639.297369] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 639.297369] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.297369] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.297369] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.298143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 639.351294] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.352362] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.352362] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.358820] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.359042] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.360314] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.364035] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.364035] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.364204] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 639.364366] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 639.364462] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 639.364805] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 639.365081] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.365430] nova-scheduler[51488]: DEBUG nova.filters [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 639.365700] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 72.213834 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 639.365866] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 639.366038] nova-scheduler[51488]: INFO nova.filters [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Filter ComputeFilter returned 0 hosts [ 639.366206] nova-scheduler[51488]: DEBUG nova.filters [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Filtering removed all hosts for the request with instance ID '3028cdf7-9f75-4885-890b-674fa5d8fb8e'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 639.366349] nova-scheduler[51488]: INFO nova.filters [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Filtering removed all hosts for the request with instance ID '3028cdf7-9f75-4885-890b-674fa5d8fb8e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 639.366533] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 639.366686] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7d0873a7-03e7-4e69-b20c-aa47f3a7d2e3 tempest-ServerActionsTestOtherA-1873380137 tempest-ServerActionsTestOtherA-1873380137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 642.533922] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Starting to schedule for instances: ['20d8b47b-db01-4d01-876d-1fd495213586'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 642.534260] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 642.534433] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.534889] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.534889] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.535079] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 642.584558] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.584793] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.584962] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.592169] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.592403] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.592571] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.594636] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.595045] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.595484] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 642.595852] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 642.596117] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 642.596298] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 642.596469] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.596792] nova-scheduler[51486]: DEBUG nova.filters [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 642.596931] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 75.445099 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 642.597101] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 642.597256] nova-scheduler[51486]: INFO nova.filters [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Filter ComputeFilter returned 0 hosts [ 642.597408] nova-scheduler[51486]: DEBUG nova.filters [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Filtering removed all hosts for the request with instance ID '20d8b47b-db01-4d01-876d-1fd495213586'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 642.597550] nova-scheduler[51486]: INFO nova.filters [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Filtering removed all hosts for the request with instance ID '20d8b47b-db01-4d01-876d-1fd495213586'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 642.597732] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 642.597830] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-a3c53a00-f0a1-4406-a238-c8eb7950197f tempest-VolumesAssistedSnapshotsTest-1589885551 tempest-VolumesAssistedSnapshotsTest-1589885551-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 645.652152] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Starting to schedule for instances: ['e8107072-246c-4343-b683-db23907b1008'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 645.652152] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 645.652152] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 645.652152] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 645.652152] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 645.652592] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 645.708593] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 645.708987] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 645.709660] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 645.718041] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 645.718259] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 645.718854] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 645.720841] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 645.722918] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 645.723322] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 645.723658] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 645.724316] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 645.724316] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 645.724316] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 645.724833] nova-scheduler[51488]: DEBUG nova.filters [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 645.724833] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 78.572933 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 645.725156] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 645.725270] nova-scheduler[51488]: INFO nova.filters [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filter ComputeFilter returned 0 hosts [ 645.726039] nova-scheduler[51488]: DEBUG nova.filters [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filtering removed all hosts for the request with instance ID 'e8107072-246c-4343-b683-db23907b1008'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 645.726039] nova-scheduler[51488]: INFO nova.filters [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filtering removed all hosts for the request with instance ID 'e8107072-246c-4343-b683-db23907b1008'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 645.726039] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 645.726039] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-05df4335-ed9d-4666-8d80-38a0499b014c tempest-MigrationsAdminTest-2033893428 tempest-MigrationsAdminTest-2033893428-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 647.545262] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Starting to schedule for instances: ['6ce0aed4-9742-4bf0-8724-8acdf130f234'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 647.545262] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 647.545262] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.545262] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.546153] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.546567] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 647.597043] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.597345] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.597521] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.612672] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.612888] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.613069] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.615600] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.615926] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.616344] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 647.616649] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 647.617087] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 647.617206] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 647.618780] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.618780] nova-scheduler[51486]: DEBUG nova.filters [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 647.618780] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 80.46602 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 647.618780] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 647.618934] nova-scheduler[51486]: INFO nova.filters [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Filter ComputeFilter returned 0 hosts [ 647.618934] nova-scheduler[51486]: DEBUG nova.filters [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Filtering removed all hosts for the request with instance ID '6ce0aed4-9742-4bf0-8724-8acdf130f234'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 647.618934] nova-scheduler[51486]: INFO nova.filters [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Filtering removed all hosts for the request with instance ID '6ce0aed4-9742-4bf0-8724-8acdf130f234'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 647.618934] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 647.618934] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-170db7a1-1255-425e-b10d-d95cca39d743 tempest-ServersWithSpecificFlavorTestJSON-1751259710 tempest-ServersWithSpecificFlavorTestJSON-1751259710-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 649.458938] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Starting to schedule for instances: ['3dcc917a-ad87-4f2f-a2c5-b281c8d600c9'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 649.459243] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 649.459428] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 649.459643] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 649.459796] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 649.459986] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 649.513278] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.513669] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.513889] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.521120] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.521383] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.521584] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.523810] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.524092] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.525855] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 649.525991] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 649.525991] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 649.525991] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 649.526159] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.526159] nova-scheduler[51488]: DEBUG nova.filters [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 649.526159] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 82.374079 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 649.526274] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 649.526916] nova-scheduler[51488]: INFO nova.filters [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filter ComputeFilter returned 0 hosts [ 649.526916] nova-scheduler[51488]: DEBUG nova.filters [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filtering removed all hosts for the request with instance ID '3dcc917a-ad87-4f2f-a2c5-b281c8d600c9'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 649.526916] nova-scheduler[51488]: INFO nova.filters [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filtering removed all hosts for the request with instance ID '3dcc917a-ad87-4f2f-a2c5-b281c8d600c9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 649.526916] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 649.527109] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-56270c1b-ae26-4b7e-ae67-1231ac6565e3 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 654.831720] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Starting to schedule for instances: ['0402a414-f52b-44dc-9050-c97546559633'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 654.835171] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 654.836337] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.836337] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.836337] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.836337] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 654.891551] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.891551] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.891713] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.899554] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.899711] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.899868] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.902500] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.902701] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.903390] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 654.903754] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 654.903881] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 654.904077] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 654.904271] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.904526] nova-scheduler[51486]: DEBUG nova.filters [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 654.906729] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 87.752907 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 654.906729] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 654.906729] nova-scheduler[51486]: INFO nova.filters [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Filter ComputeFilter returned 0 hosts [ 654.906729] nova-scheduler[51486]: DEBUG nova.filters [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Filtering removed all hosts for the request with instance ID '0402a414-f52b-44dc-9050-c97546559633'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 654.906729] nova-scheduler[51486]: INFO nova.filters [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Filtering removed all hosts for the request with instance ID '0402a414-f52b-44dc-9050-c97546559633'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 654.906961] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 654.906961] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-dd3ece74-d6b0-4955-9a12-dad49aac77d6 tempest-ImagesOneServerNegativeTestJSON-2043593551 tempest-ImagesOneServerNegativeTestJSON-2043593551-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 657.725798] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Starting to schedule for instances: ['06baf26d-b386-4458-800d-33273dc444d8'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 657.726109] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 657.726281] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 657.726462] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 657.726650] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 657.726832] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 657.768205] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.768518] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.768787] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.780454] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.780739] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.781905] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.783711] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.785150] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.785365] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 657.785502] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 657.785502] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 657.785822] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 657.785822] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.786212] nova-scheduler[51488]: DEBUG nova.filters [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 657.786462] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 90.634605 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 657.786643] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 657.786828] nova-scheduler[51488]: INFO nova.filters [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ComputeFilter returned 0 hosts [ 657.787054] nova-scheduler[51488]: DEBUG nova.filters [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtering removed all hosts for the request with instance ID '06baf26d-b386-4458-800d-33273dc444d8'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 657.787644] nova-scheduler[51488]: INFO nova.filters [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtering removed all hosts for the request with instance ID '06baf26d-b386-4458-800d-33273dc444d8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 657.787644] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 657.787644] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b262ed72-0fe3-4190-9439-f8d39ac529b7 tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 659.182441] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Starting to schedule for instances: ['fd49b27a-3d42-40a3-9e8a-750ba0c38fd2'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 659.182952] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 659.182952] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.185228] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.185567] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.186406] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 659.231052] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.232188] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.232188] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.241873] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.242255] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.242337] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.245342] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.245593] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.246030] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 659.246372] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 659.246805] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 659.247115] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 659.247327] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.247735] nova-scheduler[51486]: DEBUG nova.filters [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 659.247944] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 92.09609 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 659.248257] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 659.248329] nova-scheduler[51486]: INFO nova.filters [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Filter ComputeFilter returned 0 hosts [ 659.249073] nova-scheduler[51486]: DEBUG nova.filters [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Filtering removed all hosts for the request with instance ID 'fd49b27a-3d42-40a3-9e8a-750ba0c38fd2'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 659.249073] nova-scheduler[51486]: INFO nova.filters [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Filtering removed all hosts for the request with instance ID 'fd49b27a-3d42-40a3-9e8a-750ba0c38fd2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 659.249073] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 659.249073] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8d2a1bb9-143c-4d5d-9d88-37c15dfc27fa tempest-ServerAddressesNegativeTestJSON-1406070644 tempest-ServerAddressesNegativeTestJSON-1406070644-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 659.572368] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Starting to schedule for instances: ['f30e9d3d-eb7b-46d7-9b0e-1e949a5033d1'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 659.572703] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 659.572958] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.573331] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.573669] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.573889] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 659.631253] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.632632] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.632632] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.642678] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.642907] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.643088] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.646495] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.647094] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.647801] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 659.648129] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 659.648343] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 659.648832] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 659.648832] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.648933] nova-scheduler[51488]: DEBUG nova.filters [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 659.649173] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 92.497298 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 659.649616] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 659.649770] nova-scheduler[51488]: INFO nova.filters [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Filter ComputeFilter returned 0 hosts [ 659.649922] nova-scheduler[51488]: DEBUG nova.filters [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Filtering removed all hosts for the request with instance ID 'f30e9d3d-eb7b-46d7-9b0e-1e949a5033d1'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 659.650083] nova-scheduler[51488]: INFO nova.filters [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Filtering removed all hosts for the request with instance ID 'f30e9d3d-eb7b-46d7-9b0e-1e949a5033d1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 659.650893] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 659.650893] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-67ddd93a-3ef2-4424-8262-3058a252c8cb tempest-ServerMetadataNegativeTestJSON-2039686071 tempest-ServerMetadataNegativeTestJSON-2039686071-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.060210] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Starting to schedule for instances: ['6d68f6fb-899b-4cb5-be22-aae71ab44461'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.060508] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.061015] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.061276] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.061766] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.062068] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.118127] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.118363] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.118539] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.130074] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.130074] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.130270] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.132733] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.132943] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.133573] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.133809] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.133809] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.133904] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.134228] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.135205] nova-scheduler[51486]: DEBUG nova.filters [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.135462] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 92.98359 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.135615] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 660.135772] nova-scheduler[51486]: INFO nova.filters [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Filter ComputeFilter returned 0 hosts [ 660.136093] nova-scheduler[51486]: DEBUG nova.filters [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Filtering removed all hosts for the request with instance ID '6d68f6fb-899b-4cb5-be22-aae71ab44461'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.136093] nova-scheduler[51486]: INFO nova.filters [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Filtering removed all hosts for the request with instance ID '6d68f6fb-899b-4cb5-be22-aae71ab44461'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.136212] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.136935] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f18b2a0f-b3fe-4c5e-ad1d-7c439cbab054 tempest-ServerShowV257Test-1213354931 tempest-ServerShowV257Test-1213354931-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 661.524420] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Starting to schedule for instances: ['31fb5f08-3830-42dc-9a55-13680e8aebc9'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 661.524714] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 661.524873] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.525094] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.525893] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.525893] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 661.573255] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.573255] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.573255] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.579838] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.580327] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.580327] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.584226] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.584226] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.584394] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 661.584475] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 661.584475] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 661.584475] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 661.584593] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.584593] nova-scheduler[51488]: DEBUG nova.filters [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 661.584593] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 94.432741 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 661.585198] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 661.585198] nova-scheduler[51488]: INFO nova.filters [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filter ComputeFilter returned 0 hosts [ 661.585198] nova-scheduler[51488]: DEBUG nova.filters [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filtering removed all hosts for the request with instance ID '31fb5f08-3830-42dc-9a55-13680e8aebc9'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 661.585198] nova-scheduler[51488]: INFO nova.filters [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filtering removed all hosts for the request with instance ID '31fb5f08-3830-42dc-9a55-13680e8aebc9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 661.585884] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 661.585884] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3f055c10-050f-4ca5-849d-8affb799ca22 tempest-VolumesAdminNegativeTest-1034842400 tempest-VolumesAdminNegativeTest-1034842400-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 662.162020] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Starting to schedule for instances: ['004a8d3e-78f8-4828-9fa9-7a1e61bcb659'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 662.162020] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 662.162020] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.162020] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.162020] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.162821] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 662.212649] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.212974] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.213200] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.222743] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.222856] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.223032] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.225156] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.225310] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.225697] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 662.225986] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 662.226180] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 662.226339] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 662.226503] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.226783] nova-scheduler[51486]: DEBUG nova.filters [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 662.227085] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 95.075161 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 662.227424] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 662.227630] nova-scheduler[51486]: INFO nova.filters [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Filter ComputeFilter returned 0 hosts [ 662.227786] nova-scheduler[51486]: DEBUG nova.filters [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Filtering removed all hosts for the request with instance ID '004a8d3e-78f8-4828-9fa9-7a1e61bcb659'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 662.227928] nova-scheduler[51486]: INFO nova.filters [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Filtering removed all hosts for the request with instance ID '004a8d3e-78f8-4828-9fa9-7a1e61bcb659'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 662.228088] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 662.228460] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5d8071f5-81ec-4c91-8297-488d4c9d7020 tempest-ServersTestBootFromVolume-1180141265 tempest-ServersTestBootFromVolume-1180141265-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 662.864721] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Starting to schedule for instances: ['4f41019c-0e3f-4fd8-9dbb-530fb56d64cd'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 662.866058] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 662.867034] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.867034] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.867034] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.867034] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 662.919062] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.920070] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.920070] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.929167] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.929401] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.930217] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.933169] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.934051] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.935500] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 662.937232] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 662.937232] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 662.937232] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 662.937440] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.937440] nova-scheduler[51488]: DEBUG nova.filters [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 662.937440] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 95.784994 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 662.937440] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 662.937440] nova-scheduler[51488]: INFO nova.filters [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Filter ComputeFilter returned 0 hosts [ 662.937645] nova-scheduler[51488]: DEBUG nova.filters [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Filtering removed all hosts for the request with instance ID '4f41019c-0e3f-4fd8-9dbb-530fb56d64cd'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 662.937645] nova-scheduler[51488]: INFO nova.filters [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Filtering removed all hosts for the request with instance ID '4f41019c-0e3f-4fd8-9dbb-530fb56d64cd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 662.937645] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 662.938991] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a8ecc63d-e507-4fe6-9beb-095ab18f70d1 tempest-ServerGroupTestJSON-410967719 tempest-ServerGroupTestJSON-410967719-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 664.754492] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Starting to schedule for instances: ['19fb840a-24b5-4e5b-bdeb-03d1c999fbf5', '9f771cd7-5b7a-42bb-8858-f9b8e697753a', 'b8befe85-86dc-41de-81a1-00493408c503'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 664.754782] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 664.754946] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.755281] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.755631] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.755825] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 664.798480] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.798480] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.798480] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.805533] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.805743] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.805896] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.807855] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.808083] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.808436] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 664.808711] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 664.808876] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 664.809123] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 664.809372] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.809451] nova-scheduler[51486]: DEBUG nova.filters [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.809619] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 97.6578 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 664.809819] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 664.810228] nova-scheduler[51486]: INFO nova.filters [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Filter ComputeFilter returned 0 hosts [ 664.810498] nova-scheduler[51486]: DEBUG nova.filters [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Filtering removed all hosts for the request with instance ID '19fb840a-24b5-4e5b-bdeb-03d1c999fbf5'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 664.810568] nova-scheduler[51486]: INFO nova.filters [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Filtering removed all hosts for the request with instance ID '19fb840a-24b5-4e5b-bdeb-03d1c999fbf5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 664.810723] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.810977] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-204bf8a0-ce35-4e10-943d-9a997f4f82e4 tempest-ListServersNegativeTestJSON-897157531 tempest-ListServersNegativeTestJSON-897157531-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 665.390767] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['f3614aae-4ef1-4cfc-a27c-c149c4605eb7'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 665.396088] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 665.396419] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.396624] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.396822] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.397138] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 665.457792] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.457792] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.457939] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.465271] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.465395] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.465564] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.467957] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.468166] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.469126] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 665.469266] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 665.469319] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 665.469483] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 665.469656] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.470463] nova-scheduler[51488]: DEBUG nova.filters [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 665.471728] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 98.318297 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 665.471946] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 665.472150] nova-scheduler[51488]: INFO nova.filters [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 0 hosts [ 665.472303] nova-scheduler[51488]: DEBUG nova.filters [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'f3614aae-4ef1-4cfc-a27c-c149c4605eb7'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 665.472440] nova-scheduler[51488]: INFO nova.filters [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'f3614aae-4ef1-4cfc-a27c-c149c4605eb7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 665.472901] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 665.472901] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-408ce9f4-dcff-457d-8ba9-4466c7e53ee6 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 667.392991] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Starting to schedule for instances: ['1f25d8f9-cb9c-4a92-adbd-af7fa5afb928'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 667.392991] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 667.395022] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.397259] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.397259] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.397259] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 667.458072] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.458819] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.460985] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.468641] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.468935] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.469177] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.474236] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.474533] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.475032] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 667.475483] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 667.475717] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 667.475936] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 667.477088] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.477088] nova-scheduler[51486]: DEBUG nova.filters [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 667.477088] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 100.324809 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 667.477088] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 667.477088] nova-scheduler[51486]: INFO nova.filters [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filter ComputeFilter returned 0 hosts [ 667.477314] nova-scheduler[51486]: DEBUG nova.filters [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filtering removed all hosts for the request with instance ID '1f25d8f9-cb9c-4a92-adbd-af7fa5afb928'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 667.477896] nova-scheduler[51486]: INFO nova.filters [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filtering removed all hosts for the request with instance ID '1f25d8f9-cb9c-4a92-adbd-af7fa5afb928'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 667.478141] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 667.478372] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-fcd5e763-e850-4a3e-9f48-a94fc15ba67b tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 670.723678] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Starting to schedule for instances: ['4dbd4c88-e363-455f-9b91-30759dc5a980'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 670.723959] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 670.724138] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.724409] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.724540] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.724712] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 670.789925] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.790796] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.791094] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.799836] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.799836] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.799836] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.801547] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.801882] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.804244] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 670.804335] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-16T19:47:01Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-1039116459',updated_at=None,uuid=e33d7a65-77fe-4127-b26c-5b0841e21dfd)] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 670.804335] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 670.804335] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 670.804551] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.805423] nova-scheduler[51488]: DEBUG nova.filters [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 670.805761] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 103.653895 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 670.806141] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 670.806497] nova-scheduler[51488]: INFO nova.filters [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filter ComputeFilter returned 0 hosts [ 670.806753] nova-scheduler[51488]: DEBUG nova.filters [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filtering removed all hosts for the request with instance ID '4dbd4c88-e363-455f-9b91-30759dc5a980'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 670.808059] nova-scheduler[51488]: INFO nova.filters [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filtering removed all hosts for the request with instance ID '4dbd4c88-e363-455f-9b91-30759dc5a980'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 670.808059] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 670.808059] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9216ac51-5968-4cb6-bc42-95b07c4794bc tempest-ServersAdminTestJSON-1722488067 tempest-ServersAdminTestJSON-1722488067-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 674.155385] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting to schedule for instances: ['9312ac13-d326-4b78-8811-bd6ef0a131f6'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 674.155678] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 674.155838] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.156021] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.157052] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.157634] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 674.208833] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.209060] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.209346] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.217893] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.218157] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.218344] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.220679] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.221283] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.221659] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 674.222149] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-16T19:47:01Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-1039116459',updated_at=None,uuid=e33d7a65-77fe-4127-b26c-5b0841e21dfd)] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 674.222857] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 674.222857] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 674.223017] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.223201] nova-scheduler[51486]: DEBUG nova.filters [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 674.224535] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 107.071581 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 674.224535] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 674.224535] nova-scheduler[51486]: INFO nova.filters [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ComputeFilter returned 0 hosts [ 674.224535] nova-scheduler[51486]: DEBUG nova.filters [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtering removed all hosts for the request with instance ID '9312ac13-d326-4b78-8811-bd6ef0a131f6'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 674.224535] nova-scheduler[51486]: INFO nova.filters [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtering removed all hosts for the request with instance ID '9312ac13-d326-4b78-8811-bd6ef0a131f6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 674.226037] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 674.226037] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-18c51dbc-82a7-4bed-b87d-8710f02c8170 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 674.698265] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Starting to schedule for instances: ['1935fe90-9de6-49c9-83ef-b1c8031369d1'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 674.698806] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 674.698874] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.699081] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.699296] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.699492] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 674.754507] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.755850] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.755850] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.765721] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.765721] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.765721] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.768878] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.768878] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.769101] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 674.770206] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-16T19:47:01Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-1039116459',updated_at=None,uuid=e33d7a65-77fe-4127-b26c-5b0841e21dfd)] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 674.770206] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 674.770206] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 674.770421] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.770537] nova-scheduler[51488]: DEBUG nova.filters [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 674.770807] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 107.618941 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 674.770993] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 674.771216] nova-scheduler[51488]: INFO nova.filters [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Filter ComputeFilter returned 0 hosts [ 674.772528] nova-scheduler[51488]: DEBUG nova.filters [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Filtering removed all hosts for the request with instance ID '1935fe90-9de6-49c9-83ef-b1c8031369d1'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 674.772528] nova-scheduler[51488]: INFO nova.filters [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Filtering removed all hosts for the request with instance ID '1935fe90-9de6-49c9-83ef-b1c8031369d1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 674.772528] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 674.773091] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e911fecf-ed9d-4a23-a5d9-039a3870be0f tempest-ServerTagsTestJSON-771597267 tempest-ServerTagsTestJSON-771597267-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 678.397119] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Starting to schedule for instances: ['c4581143-aeab-4b2a-a174-ddeeaa8fac2a'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 678.397426] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 678.397518] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 678.397692] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 678.397904] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 678.398544] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 678.444502] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.445213] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.445452] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.454364] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.454364] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.454364] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.457278] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.457473] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.458034] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 678.458450] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 678.458555] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 678.458664] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 678.458802] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.459086] nova-scheduler[51486]: DEBUG nova.filters [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 678.459313] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 111.307467 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 678.459622] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 678.459622] nova-scheduler[51486]: INFO nova.filters [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Filter ComputeFilter returned 0 hosts [ 678.459763] nova-scheduler[51486]: DEBUG nova.filters [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Filtering removed all hosts for the request with instance ID 'c4581143-aeab-4b2a-a174-ddeeaa8fac2a'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 678.459876] nova-scheduler[51486]: INFO nova.filters [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Filtering removed all hosts for the request with instance ID 'c4581143-aeab-4b2a-a174-ddeeaa8fac2a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 678.460043] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 678.460215] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-38bc19be-2acd-4d3e-9761-2b01eb3eed70 tempest-InstanceActionsTestJSON-1347369542 tempest-InstanceActionsTestJSON-1347369542-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 679.508520] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.508520] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.508520] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.508899] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.509039] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.509080] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.509116] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.509728] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.514070] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.514070] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.515723] nova-scheduler[51486]: INFO nova.scheduler.host_manager [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 679.515723] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.008s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.520369] nova-scheduler[51488]: INFO nova.scheduler.host_manager [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 679.520369] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a7aab517-6481-412c-add3-d370c71133b6 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.012s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.318520] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['e0306583-b015-4154-8452-af5bf88d0c6e'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 680.318885] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 680.319127] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.320360] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.320615] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.321025] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 680.371972] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.372230] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.372412] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.379290] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.379508] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.379610] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.381588] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.381779] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.382166] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_138039fed4eb4e17a4d7c396fc58e157='0',num_proj_26daced2efba4563aad36c2b98b1cc85='0',num_proj_29492fb1a4a3464ba0b3904562c4df99='0',num_proj_50174144e5d848ab94ee41b0e9cdc2d5='0',num_proj_57aecfe513b64d13971574d0920a47e7='0',num_proj_69230e047a304d339209621a4da6d72e='0',num_proj_88bd5475f9aa4c0db831466e666607ad='0',num_proj_c151ec284e644559b18bf267868e96ef='0',num_proj_cc065469898443b8ab77b8a7b07f39b2='0',num_proj_f35535d2e68e42dd87b1629dc319e460='0',num_proj_fceda5af1ddf4ce7ba350329af14baf7='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:46:30Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 680.382679] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 680.382679] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 680.382788] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 680.382999] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.383216] nova-scheduler[51488]: DEBUG nova.filters [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 680.383418] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 113.231594 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 680.383567] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 680.383711] nova-scheduler[51488]: INFO nova.filters [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 0 hosts [ 680.383879] nova-scheduler[51488]: DEBUG nova.filters [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'e0306583-b015-4154-8452-af5bf88d0c6e'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 680.384019] nova-scheduler[51488]: INFO nova.filters [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'e0306583-b015-4154-8452-af5bf88d0c6e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 680.384147] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 680.384320] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be9354f4-de2e-4c50-848f-0918bd67c7ee tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 682.437303] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Starting to schedule for instances: ['4f14095c-8bc3-43f9-909b-7d62cc4eb27e'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 682.437303] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 682.437303] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.437303] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.437698] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.437698] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 682.486542] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.488335] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.488335] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.496024] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.496024] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.496024] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.497838] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.498295] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.499069] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 682.499329] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 682.499582] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 682.500594] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 682.500770] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.501052] nova-scheduler[51486]: DEBUG nova.filters [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 682.501270] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 115.349436 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 682.501429] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 682.501582] nova-scheduler[51486]: INFO nova.filters [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Filter ComputeFilter returned 0 hosts [ 682.501843] nova-scheduler[51486]: DEBUG nova.filters [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Filtering removed all hosts for the request with instance ID '4f14095c-8bc3-43f9-909b-7d62cc4eb27e'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 682.501897] nova-scheduler[51486]: INFO nova.filters [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Filtering removed all hosts for the request with instance ID '4f14095c-8bc3-43f9-909b-7d62cc4eb27e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 682.501999] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 682.502151] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5e7575bc-0886-48ca-8ccb-92f82f8bc09e tempest-AttachInterfacesUnderV243Test-1723653673 tempest-AttachInterfacesUnderV243Test-1723653673-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 682.669135] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Starting to schedule for instances: ['d73d4749-821f-4db1-b276-52a0d84c1f5a'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 682.669520] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 682.669689] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.669873] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.670084] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.670268] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 682.717123] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.717427] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.717656] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.725929] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.726190] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.726453] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.728799] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.729169] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.729599] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 682.729934] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 682.730151] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 682.730390] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 682.730606] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.730934] nova-scheduler[51488]: DEBUG nova.filters [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 682.731428] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 115.579539 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 682.731630] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 682.731812] nova-scheduler[51488]: INFO nova.filters [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Filter ComputeFilter returned 0 hosts [ 682.732066] nova-scheduler[51488]: DEBUG nova.filters [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Filtering removed all hosts for the request with instance ID 'd73d4749-821f-4db1-b276-52a0d84c1f5a'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 682.732295] nova-scheduler[51488]: INFO nova.filters [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Filtering removed all hosts for the request with instance ID 'd73d4749-821f-4db1-b276-52a0d84c1f5a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 682.732515] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 682.732700] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-04a74e70-f289-4265-8f09-a82c6dcf04e4 tempest-InstanceActionsNegativeTestJSON-1405194324 tempest-InstanceActionsNegativeTestJSON-1405194324-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 685.847811] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Starting to schedule for instances: ['b01bf593-8815-4830-8853-77aa870c5acf'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 685.848117] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 685.848281] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.848820] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.848820] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.848905] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 685.898260] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.898985] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.898985] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.907479] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.908616] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.908616] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.910412] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.910983] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.912735] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 685.912735] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 685.912865] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 685.912865] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 685.912865] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.912997] nova-scheduler[51486]: DEBUG nova.filters [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 685.912997] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 118.760706 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 685.912997] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 685.913413] nova-scheduler[51486]: INFO nova.filters [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filter ComputeFilter returned 0 hosts [ 685.913676] nova-scheduler[51486]: DEBUG nova.filters [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtering removed all hosts for the request with instance ID 'b01bf593-8815-4830-8853-77aa870c5acf'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 685.914362] nova-scheduler[51486]: INFO nova.filters [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtering removed all hosts for the request with instance ID 'b01bf593-8815-4830-8853-77aa870c5acf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 685.914659] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 685.915017] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-c94df66d-0c11-49eb-827a-97abce681cba tempest-AttachInterfacesTestJSON-852401293 tempest-AttachInterfacesTestJSON-852401293-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 687.221125] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting to schedule for instances: ['52c64678-da09-429c-a5c4-c3ff38ca1c3a'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 687.221897] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 687.221897] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.221897] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.222093] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.222244] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 687.287910] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.287910] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.287910] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.294393] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.295493] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.295493] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.296711] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.296932] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.297322] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 687.297618] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 687.297781] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 45, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 687.297927] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 687.298100] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.298350] nova-scheduler[51488]: DEBUG nova.filters [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 687.298563] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:45:21. Elapsed time is 120.14673 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 687.298706] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 687.298851] nova-scheduler[51488]: INFO nova.filters [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ComputeFilter returned 0 hosts [ 687.298994] nova-scheduler[51488]: DEBUG nova.filters [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtering removed all hosts for the request with instance ID '52c64678-da09-429c-a5c4-c3ff38ca1c3a'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 687.299219] nova-scheduler[51488]: INFO nova.filters [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtering removed all hosts for the request with instance ID '52c64678-da09-429c-a5c4-c3ff38ca1c3a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 687.299366] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 687.299508] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3ae5c808-c989-43fb-a404-c76a05f12571 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 688.822184] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Starting to schedule for instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 688.822184] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 688.822184] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.822184] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.822184] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.822700] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 688.887794] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.888237] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.888237] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.897844] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.898208] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.898400] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.901263] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.901263] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.901568] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=0) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 688.901844] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 688.902012] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 688.902395] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 688.902395] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.902683] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 688.902976] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.903138] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.903728] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.903728] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.903728] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.903866] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.904277] nova-scheduler[51486]: DEBUG nova.filters [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 688.904641] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 688.904641] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 688.904817] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Attempting to claim resources in the placement API for instance 053d549e-b3d6-4498-9261-cfacaf8b43bd {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 688.980473] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] [instance: 053d549e-b3d6-4498-9261-cfacaf8b43bd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 688.981178] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.981178] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.981178] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f777dab6-5220-427c-ad83-c515f417aa1e tempest-ServerDiagnosticsV248Test-1888611138 tempest-ServerDiagnosticsV248Test-1888611138-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.125501] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['7552a136-0a44-43a0-909a-3495eddaa4c9'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 691.125865] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 691.126000] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.126406] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.126641] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.126828] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 691.191227] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.191464] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.191634] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.200812] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.201028] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.201188] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.203416] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.203623] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.203986] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='11',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:23Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 691.204283] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 691.204450] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 691.204628] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 691.204790] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.205050] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 691.205252] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.205427] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.205648] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.205846] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.206015] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.206178] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.206333] nova-scheduler[51488]: DEBUG nova.filters [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.206486] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 691.206651] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 691.206822] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Attempting to claim resources in the placement API for instance 7552a136-0a44-43a0-909a-3495eddaa4c9 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 691.268644] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] [instance: 7552a136-0a44-43a0-909a-3495eddaa4c9] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 691.268644] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.268644] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.268843] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1e60474e-9714-4782-89ca-fc2b10d2d3f0 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.047998] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Starting to schedule for instances: ['fcdac100-e2fe-434e-87ca-0a174ecfb0e6'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 697.048327] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 697.048506] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 697.048701] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 697.048996] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 697.051172] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 697.097471] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting to schedule for instances: ['86b1de9b-bfc7-4810-9906-e59e01f11594'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 697.098474] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 697.098657] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 697.098839] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 697.099044] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 697.099218] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 697.131973] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.132152] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.133019] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.143667] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.143885] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.144060] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.146515] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.146717] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.147111] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='11',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:25Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 697.147439] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 697.147658] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 697.147760] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', '7552a136-0a44-43a0-909a-3495eddaa4c9'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 697.147914] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.148209] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 697.148413] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.148597] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.148791] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.148948] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.149117] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.149276] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.149463] nova-scheduler[51486]: DEBUG nova.filters [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.149580] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 697.149744] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 697.149913] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Attempting to claim resources in the placement API for instance fcdac100-e2fe-434e-87ca-0a174ecfb0e6 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 697.172361] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.172637] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.172822] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.182843] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.183122] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.183941] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.189245] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.189245] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.189384] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='11',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:25Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 697.189384] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 697.189471] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 697.189471] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', '7552a136-0a44-43a0-909a-3495eddaa4c9'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 697.189471] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.189566] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 697.189566] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.189566] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.189566] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.189566] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.189566] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.189933] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.190534] nova-scheduler[51488]: DEBUG nova.filters [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 697.190875] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 697.191151] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 697.191557] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Attempting to claim resources in the placement API for instance 86b1de9b-bfc7-4810-9906-e59e01f11594 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 697.223118] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] [instance: fcdac100-e2fe-434e-87ca-0a174ecfb0e6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 697.223118] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.223118] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.223118] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-e06fa61f-8129-4316-9346-c7d6ce47d124 tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 697.264232] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] [instance: 86b1de9b-bfc7-4810-9906-e59e01f11594] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 697.264540] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 697.264952] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 697.265026] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8e0a0a12-bbba-4b09-a2e2-0f0146ebae15 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.194882] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Starting to schedule for instances: ['11ff4621-5da2-4da3-97bf-2ff6b231233c'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 698.194882] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 698.195162] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.195162] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.196019] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.196019] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 698.242222] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.242452] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.242965] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.252554] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.252881] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.253091] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.255963] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.255963] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.256266] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='11',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:31Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=4) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 698.256266] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 698.256358] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 698.256556] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', '7552a136-0a44-43a0-909a-3495eddaa4c9', 'fcdac100-e2fe-434e-87ca-0a174ecfb0e6', '86b1de9b-bfc7-4810-9906-e59e01f11594'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 698.256615] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.256856] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 698.257110] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.257309] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.257507] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.257673] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.257834] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.257999] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.258179] nova-scheduler[51486]: DEBUG nova.filters [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.258333] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 698.258494] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 698.258669] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Attempting to claim resources in the placement API for instance 11ff4621-5da2-4da3-97bf-2ff6b231233c {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 698.312796] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] [instance: 11ff4621-5da2-4da3-97bf-2ff6b231233c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 698.313116] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.313334] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.313534] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-08927b82-ba38-431b-b04d-3609bb83d66b tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.969600] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Starting to schedule for instances: ['68f534dd-7119-48f4-85ae-14bfdf68d486'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 700.969956] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 700.970313] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.970463] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.970901] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.970901] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 701.021318] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.021556] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.022217] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.030350] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.030350] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.030494] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.032965] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.033180] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.033550] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='11',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:32Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=5) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 701.038044] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 701.038044] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 701.038044] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', '7552a136-0a44-43a0-909a-3495eddaa4c9', 'fcdac100-e2fe-434e-87ca-0a174ecfb0e6', '86b1de9b-bfc7-4810-9906-e59e01f11594', '11ff4621-5da2-4da3-97bf-2ff6b231233c'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 701.038451] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.038451] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 701.038451] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038451] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038451] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038610] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038610] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038610] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038610] nova-scheduler[51488]: DEBUG nova.filters [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.038610] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 701.038727] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 701.038727] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Attempting to claim resources in the placement API for instance 68f534dd-7119-48f4-85ae-14bfdf68d486 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 701.113175] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] [instance: 68f534dd-7119-48f4-85ae-14bfdf68d486] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 701.114622] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.114622] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.114622] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d5c690c5-8615-45b1-bbc9-dde29baf475c tempest-ServerActionsTestJSON-634471831 tempest-ServerActionsTestJSON-634471831-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.585339] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Starting to schedule for instances: ['1b3f51ff-2374-499e-8d60-6a0e5cdd2609'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 701.588447] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 701.588447] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 701.588447] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 701.589435] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 701.589435] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 701.635102] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.635102] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.635102] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.645099] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.646262] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.646262] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.648271] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.648471] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.648888] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='11',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:35Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 701.649207] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 701.649384] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 701.649701] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', '7552a136-0a44-43a0-909a-3495eddaa4c9', 'fcdac100-e2fe-434e-87ca-0a174ecfb0e6', '86b1de9b-bfc7-4810-9906-e59e01f11594', '11ff4621-5da2-4da3-97bf-2ff6b231233c', '68f534dd-7119-48f4-85ae-14bfdf68d486'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 701.649701] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.649930] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 701.650274] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.650317] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.650512] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.650673] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.650935] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.651013] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.651443] nova-scheduler[51486]: DEBUG nova.filters [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.651443] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 701.651614] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 701.651977] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Attempting to claim resources in the placement API for instance 1b3f51ff-2374-499e-8d60-6a0e5cdd2609 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 701.712021] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] [instance: 1b3f51ff-2374-499e-8d60-6a0e5cdd2609] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 701.712375] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.712671] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.712925] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8178dce7-6b3e-4984-8bfa-5132bf8627a1 tempest-ListImageFiltersTestJSON-769684321 tempest-ListImageFiltersTestJSON-769684321-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.076705] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Starting to schedule for instances: ['5a549ffd-3cc3-4723-bfe6-510dbef0fea7'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 709.076705] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 709.076947] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.081380] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.081380] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.081380] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 709.143267] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.145219] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.145219] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.161760] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.162293] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.162717] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.168340] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.170064] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.170250] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='11',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='2',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:36Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 709.170757] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 709.170757] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 709.170891] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', 'fcdac100-e2fe-434e-87ca-0a174ecfb0e6', '86b1de9b-bfc7-4810-9906-e59e01f11594', '11ff4621-5da2-4da3-97bf-2ff6b231233c', '68f534dd-7119-48f4-85ae-14bfdf68d486', '1b3f51ff-2374-499e-8d60-6a0e5cdd2609'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 709.170939] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.173416] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 709.173416] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.174300] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.175234] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.175454] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.175687] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.175907] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.176106] nova-scheduler[51488]: DEBUG nova.filters [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.176277] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 709.176447] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 709.176626] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Attempting to claim resources in the placement API for instance 5a549ffd-3cc3-4723-bfe6-510dbef0fea7 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 709.254974] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] [instance: 5a549ffd-3cc3-4723-bfe6-510dbef0fea7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 709.255314] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.255517] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.255717] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ca7f4b7c-9942-42e1-b38d-261c70a40fd3 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.031720] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Starting to schedule for instances: ['8ebf1e27-6cc8-4122-b8b1-ed0585507bdb'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 711.036026] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 711.036026] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.040935] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.040935] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.040935] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 711.105914] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.105914] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.105914] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.114831] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.115081] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.115246] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.118705] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.119023] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.119367] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='11',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='2',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:43Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=7) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 711.119656] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 711.120151] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 711.120151] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with instances: ['053d549e-b3d6-4498-9261-cfacaf8b43bd', 'fcdac100-e2fe-434e-87ca-0a174ecfb0e6', '86b1de9b-bfc7-4810-9906-e59e01f11594', '11ff4621-5da2-4da3-97bf-2ff6b231233c', '68f534dd-7119-48f4-85ae-14bfdf68d486', '1b3f51ff-2374-499e-8d60-6a0e5cdd2609', '5a549ffd-3cc3-4723-bfe6-510dbef0fea7'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 711.120916] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.120916] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 711.120916] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.120916] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.121484] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.122219] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.122738] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.122738] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.123065] nova-scheduler[51486]: DEBUG nova.filters [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.123065] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 711.123488] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 711.123488] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Attempting to claim resources in the placement API for instance 8ebf1e27-6cc8-4122-b8b1-ed0585507bdb {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 711.195629] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] [instance: 8ebf1e27-6cc8-4122-b8b1-ed0585507bdb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 711.196116] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.196307] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.196529] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f871018d-e547-4ba6-b9af-693e9e080160 tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.943753] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-ac2edf85-7cf7-4806-a423-77c859ddddcc tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.943822] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-ac2edf85-7cf7-4806-a423-77c859ddddcc tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.944166] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-ac2edf85-7cf7-4806-a423-77c859ddddcc tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.946418] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ac2edf85-7cf7-4806-a423-77c859ddddcc tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.946418] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ac2edf85-7cf7-4806-a423-77c859ddddcc tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.946669] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ac2edf85-7cf7-4806-a423-77c859ddddcc tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.841024] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Starting to schedule for instances: ['880bddac-daec-4194-8e5d-e7aaba8c2dd1'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 715.841024] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 715.841024] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.841024] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.841024] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.841506] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 715.884089] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.884461] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.884674] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.898241] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.898611] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.899281] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='12',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02f55d9578bb4104ab4955671dfbff30='1',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='1',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:49Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 715.899281] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 715.899512] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 715.899661] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 715.900661] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.900888] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 715.901135] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.901504] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.901577] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.902669] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.902669] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.902669] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.902669] nova-scheduler[51488]: DEBUG nova.filters [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.902669] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 715.902896] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 715.902896] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Attempting to claim resources in the placement API for instance 880bddac-daec-4194-8e5d-e7aaba8c2dd1 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 715.959068] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] [instance: 880bddac-daec-4194-8e5d-e7aaba8c2dd1] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 715.959352] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.959555] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.959749] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4155c5aa-fa12-458e-8d2f-45c321b48d0f tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.207047] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Starting to schedule for instances: ['9ef14f08-3ae3-48cb-ae99-2b2731faeeab'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 717.207817] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 717.209026] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.209026] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.209026] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.209026] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 717.270635] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.272586] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.272586] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.283151] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.283366] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.283831] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='13',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:50Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 717.284176] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 717.284380] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 717.284914] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 717.285716] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.285716] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 717.285716] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.285877] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.286193] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.286363] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.286654] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.286881] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.287104] nova-scheduler[51486]: DEBUG nova.filters [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.287316] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 717.287540] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 717.287731] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Attempting to claim resources in the placement API for instance 9ef14f08-3ae3-48cb-ae99-2b2731faeeab {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 717.373626] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] [instance: 9ef14f08-3ae3-48cb-ae99-2b2731faeeab] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 717.373626] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.373626] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.373843] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-5fef9c7b-f2b7-4e82-9bf2-4ab1e3cd5b76 tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.395776] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Starting to schedule for instances: ['1d6fb105-7087-4bdf-9b1c-b194baf39a55'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 717.396606] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 717.396606] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.396606] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.396769] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.397309] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 717.456283] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.456283] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.456283] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.474407] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.474407] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.474687] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='13',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:50Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 717.474687] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 717.474812] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 717.474812] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 717.474812] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.474950] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 717.474950] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.474950] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.474950] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.474950] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.475142] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.475142] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.475142] nova-scheduler[51488]: DEBUG nova.filters [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.475142] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 717.475142] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 717.475282] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Attempting to claim resources in the placement API for instance 1d6fb105-7087-4bdf-9b1c-b194baf39a55 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 717.532350] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] [instance: 1d6fb105-7087-4bdf-9b1c-b194baf39a55] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 717.532631] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.532829] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.533036] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8401108f-42ae-487f-9b5a-e99f50239a15 tempest-ServerShowV247Test-312332432 tempest-ServerShowV247Test-312332432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.263684] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['f1e315bf-9348-4631-af77-85ec3a986a83'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 718.263927] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 718.265154] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.265154] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.265154] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.265154] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 718.317497] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.317720] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.317893] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.327967] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.327967] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.328429] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='15',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:52Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=7) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 718.328828] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 718.328931] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 718.329097] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 718.329262] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.329732] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 718.329732] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.329933] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.330094] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.330364] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.330414] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.330571] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.330727] nova-scheduler[51486]: DEBUG nova.filters [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.330883] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 718.331063] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 718.331242] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Attempting to claim resources in the placement API for instance f1e315bf-9348-4631-af77-85ec3a986a83 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 718.400524] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] [instance: f1e315bf-9348-4631-af77-85ec3a986a83] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 718.402782] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.402782] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.402782] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-36c28f5a-ddf6-45c8-a08b-1dae74d610ca tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.823607] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting to schedule for instances: ['f4a120d9-3d50-4905-bcac-c6b632fa0295', 'de33d275-2cf8-4726-9d1a-526d7556a74f'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 719.824785] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 719.825158] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 719.825448] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 719.825854] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 719.826173] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 719.883724] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.883962] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.884147] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.891558] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.891784] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.895023] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='15',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:52Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=8) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 719.895023] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 719.895497] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 719.895497] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 719.895497] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.895667] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 719.895667] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895667] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895667] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895667] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895810] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895810] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895810] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.895810] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 719.895810] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 719.896025] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Attempting to claim resources in the placement API for instance f4a120d9-3d50-4905-bcac-c6b632fa0295 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 719.974140] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] [instance: f4a120d9-3d50-4905-bcac-c6b632fa0295] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 719.974443] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.974645] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.974843] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.975122] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 719.975317] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.975561] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.975723] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 719.975958] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 719.977017] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Attempting to claim resources in the placement API for instance de33d275-2cf8-4726-9d1a-526d7556a74f {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 720.046134] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] [instance: de33d275-2cf8-4726-9d1a-526d7556a74f] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 720.046450] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 720.046660] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 720.046859] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 720.047064] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 720.047401] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 720.048488] nova-scheduler[51488]: DEBUG nova.filters [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 720.048488] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 720.048840] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f8dd3caa-cdda-4335-b9df-9dec028340f4 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 721.170188] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Starting to schedule for instances: ['f3febdda-db75-4048-a2b5-aa4daf2dcfa2'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 721.173035] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 721.173035] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 721.173035] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 721.173035] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 721.173035] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 721.225539] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.228022] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.228286] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.242109] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.242350] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.242721] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='16',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_02f55d9578bb4104ab4955671dfbff30='1',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:54Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=9) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 721.243095] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 721.243336] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 721.243548] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 721.243807] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.244381] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 721.245071] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.245414] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.245714] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.245963] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.246206] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.246422] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.246635] nova-scheduler[51486]: DEBUG nova.filters [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.246848] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 721.247174] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 721.247391] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Attempting to claim resources in the placement API for instance f3febdda-db75-4048-a2b5-aa4daf2dcfa2 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 721.296667] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] [instance: f3febdda-db75-4048-a2b5-aa4daf2dcfa2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 721.296956] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.297337] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.297610] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-69a96172-a4d6-4946-b602-31d353a5cddf tempest-ListServerFiltersTestJSON-712311738 tempest-ListServerFiltersTestJSON-712311738-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.856007] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Starting to schedule for instances: ['3a20b8f8-f10c-4303-b801-e0831da74f91'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 721.856397] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 721.856620] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 721.857244] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 721.857457] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 721.857645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 721.911022] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.911593] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.911782] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.919468] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.919680] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.920275] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194734,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1856,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='17',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:55Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=10) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 721.921030] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 721.921030] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 721.921336] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 721.922216] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.922216] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 721.922216] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.922216] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.922371] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.922471] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.922627] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.922786] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.922946] nova-scheduler[51488]: DEBUG nova.filters [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.923207] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 721.923391] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 721.923575] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Attempting to claim resources in the placement API for instance 3a20b8f8-f10c-4303-b801-e0831da74f91 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 721.985709] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] [instance: 3a20b8f8-f10c-4303-b801-e0831da74f91] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 721.986022] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.986834] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.987085] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2058984-c25d-4e88-b377-ff4a61fe0be1 tempest-ServersTestJSON-865559043 tempest-ServersTestJSON-865559043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.857567] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Starting to schedule for instances: ['e11cc8c7-86ac-49a6-b4b5-2daedf0066bb'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 724.858534] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 724.858534] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.858534] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.858534] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.860457] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 724.908818] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.909164] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.909623] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.917190] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.917406] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.917770] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194734,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1856,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='18',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:58Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=10) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 724.918069] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 724.918242] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 724.918418] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 724.918554] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.919215] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 724.919215] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.919215] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.919394] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.919598] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.919680] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.919838] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.920010] nova-scheduler[51486]: DEBUG nova.filters [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.924281] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 724.924474] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 724.924661] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Attempting to claim resources in the placement API for instance e11cc8c7-86ac-49a6-b4b5-2daedf0066bb {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 724.976940] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] [instance: e11cc8c7-86ac-49a6-b4b5-2daedf0066bb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 724.977255] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.977574] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.977657] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-494505ca-89ce-4b08-9a78-9771aed9b9e1 tempest-ServersTestFqdnHostnames-1395823399 tempest-ServersTestFqdnHostnames-1395823399-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.092198] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Starting to schedule for instances: ['c3ddcc9b-7856-4ce0-8a5c-6f5f145b2402'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 726.092533] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 726.092709] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.092890] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.093366] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.093585] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 726.151504] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.151828] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.152041] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.160039] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.160824] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.160939] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194734,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1856,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='18',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:47:58Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=10) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 726.160939] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 726.162031] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 726.162031] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 726.162031] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.162031] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 726.162258] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.162486] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.163071] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.163278] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.163485] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.163735] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.163977] nova-scheduler[51488]: DEBUG nova.filters [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.164308] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 726.164428] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 726.164595] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Attempting to claim resources in the placement API for instance c3ddcc9b-7856-4ce0-8a5c-6f5f145b2402 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 726.239087] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] [instance: c3ddcc9b-7856-4ce0-8a5c-6f5f145b2402] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 726.239762] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.239762] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.239942] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2b8d91f4-0074-4dc5-bcfb-534197c6a44b tempest-ImagesNegativeTestJSON-55314154 tempest-ImagesNegativeTestJSON-55314154-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.670855] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Starting to schedule for instances: ['cbd11b11-3927-4f2f-81c5-9e282f432273'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 726.675114] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 726.675114] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.675114] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.675114] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.675114] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 726.731498] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.731498] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.731498] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.743480] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.743628] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.743898] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194862,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1728,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='18',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_02f55d9578bb4104ab4955671dfbff30='2',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:00Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=9) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 726.744201] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 726.744407] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 726.744599] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 726.744807] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.746218] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 726.747860] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.747860] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.747929] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.748153] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.748220] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.748549] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.748549] nova-scheduler[51486]: DEBUG nova.filters [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 726.749111] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 726.749111] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 726.749111] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Attempting to claim resources in the placement API for instance cbd11b11-3927-4f2f-81c5-9e282f432273 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 726.820591] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] [instance: cbd11b11-3927-4f2f-81c5-9e282f432273] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 726.820591] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.820755] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.821092] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0cda8a7b-1695-4437-96ca-ce5bb6f5de23 tempest-ServerPasswordTestJSON-698716183 tempest-ServerPasswordTestJSON-698716183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 727.707564] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting to schedule for instances: ['55002608-7ede-4f13-a820-09f8b7da3edf'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 727.707859] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 727.708028] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 727.708212] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 727.708405] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 727.708893] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 727.756897] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.757222] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.757476] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 727.766668] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.766965] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.767503] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194862,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1728,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='19',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_02f55d9578bb4104ab4955671dfbff30='1',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_a71c30f298e84c1abc9921bbe550773e='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:01Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=9) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 727.767926] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 727.768124] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 727.768339] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 727.768563] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 727.768936] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 727.769325] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.769601] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.769868] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.770114] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.770357] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.770595] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.770832] nova-scheduler[51488]: DEBUG nova.filters [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.771071] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 727.771313] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 727.771557] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Attempting to claim resources in the placement API for instance 55002608-7ede-4f13-a820-09f8b7da3edf {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 727.837947] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] [instance: 55002608-7ede-4f13-a820-09f8b7da3edf] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 727.838266] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.838474] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.838673] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-006a62de-e4e6-4a9c-b507-e4e760611339 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.106364] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Starting to schedule for instances: ['57165716-986f-4582-ae73-e60fde250240'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 728.107305] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 728.107385] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.107556] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.107755] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.107987] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 728.160283] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.160568] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.160674] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.168450] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.169611] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.169611] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=194990,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1600,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='19',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_02f55d9578bb4104ab4955671dfbff30='1',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_a71c30f298e84c1abc9921bbe550773e='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:01Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=8) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 728.169611] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 728.169611] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 728.169611] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 728.170665] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.170665] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 728.170665] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.170846] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.171246] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.171246] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.171458] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.171535] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.172206] nova-scheduler[51486]: DEBUG nova.filters [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.172206] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 728.172206] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 728.172206] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Attempting to claim resources in the placement API for instance 57165716-986f-4582-ae73-e60fde250240 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 728.241812] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] [instance: 57165716-986f-4582-ae73-e60fde250240] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 728.242115] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.242322] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.242521] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-536d5a0f-9aea-422b-863e-90d5621382f4 tempest-ServerMetadataTestJSON-849325499 tempest-ServerMetadataTestJSON-849325499-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.184129] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Starting to schedule for instances: ['192ab790-d9db-4990-93d0-24603bd65016'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 730.184427] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 730.184584] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.184927] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.184997] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.185373] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 730.245341] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.245800] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.246053] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.254088] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.254492] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.254733] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=194990,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1600,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='21',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_02f55d9578bb4104ab4955671dfbff30='1',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1461016ded45466183d6c24bf475f4fb='1',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_887c3104a0114851982023ae4f923f34='1',num_proj_a71c30f298e84c1abc9921bbe550773e='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:03Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=8) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 730.254991] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 730.255210] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 730.255383] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 730.255556] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.255814] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 730.256029] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.256214] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.257081] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.257336] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.257522] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.257695] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.258132] nova-scheduler[51488]: DEBUG nova.filters [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.258132] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 730.258236] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 730.258384] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Attempting to claim resources in the placement API for instance 192ab790-d9db-4990-93d0-24603bd65016 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 730.324729] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] [instance: 192ab790-d9db-4990-93d0-24603bd65016] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 730.325101] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.325378] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.325813] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e649ce2a-c2c2-4c8b-bc44-e8c0a02235f6 tempest-ServersNegativeTestMultiTenantJSON-528770027 tempest-ServersNegativeTestMultiTenantJSON-528770027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.575537] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting to schedule for instances: ['744abb9c-379e-477b-a493-210cde36c314'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 730.576257] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 730.576257] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.576599] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.576942] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.577305] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 730.669958] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.670377] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.670562] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.684769] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.685079] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.685974] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=194990,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1600,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='21',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_02f55d9578bb4104ab4955671dfbff30='1',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_1461016ded45466183d6c24bf475f4fb='1',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='1',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_887c3104a0114851982023ae4f923f34='1',num_proj_a71c30f298e84c1abc9921bbe550773e='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:03Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=8) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 730.685974] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 730.686711] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 730.686711] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 730.686817] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.687129] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 730.687615] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.687780] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.688027] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.688301] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.691907] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.692125] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.692342] nova-scheduler[51486]: DEBUG nova.filters [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.692455] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 730.692949] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 730.693122] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Attempting to claim resources in the placement API for instance 744abb9c-379e-477b-a493-210cde36c314 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 730.762941] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] [instance: 744abb9c-379e-477b-a493-210cde36c314] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194990MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 730.764081] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.764081] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.764466] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-9994dfce-e774-4e95-bf5b-67baa5d03764 tempest-ImagesTestJSON-826348309 tempest-ImagesTestJSON-826348309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 738.302930] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['953994f5-677e-40a8-8008-074630080334'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 738.302930] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 738.302930] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 738.302930] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 738.303602] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 738.303895] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 738.349377] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 738.349772] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 738.349982] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 738.357292] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 738.357543] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 738.357960] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='27',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02f55d9578bb4104ab4955671dfbff30='0',num_proj_06f260ca811e4dada55813b2b8656839='1',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1461016ded45466183d6c24bf475f4fb='1',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='0',num_proj_1d356250256a467bbaf8c426158abae7='1',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_4632fed38799437594e5019a85a7bf81='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_887c3104a0114851982023ae4f923f34='0',num_proj_a71c30f298e84c1abc9921bbe550773e='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:10Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 738.358677] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 738.358855] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 738.359017] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 738.359246] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 738.359537] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 738.359886] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.360272] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.360343] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.360539] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.360708] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.360868] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.361033] nova-scheduler[51488]: DEBUG nova.filters [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 738.361193] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 738.361356] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 738.361524] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Attempting to claim resources in the placement API for instance 953994f5-677e-40a8-8008-074630080334 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 738.409263] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] [instance: 953994f5-677e-40a8-8008-074630080334] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 738.409731] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 738.410017] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 738.410228] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7291a166-2af6-4c53-bb97-62cec487b32e tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.562853] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Starting to schedule for instances: ['3b30863b-8dc5-43e1-a222-ddcc6945af5f'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 740.564457] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 740.564751] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.564910] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.565158] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.565408] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 740.624988] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.624988] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.625130] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.640656] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.640656] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.640656] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='28',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02f55d9578bb4104ab4955671dfbff30='0',num_proj_06f260ca811e4dada55813b2b8656839='1',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_1461016ded45466183d6c24bf475f4fb='0',num_proj_1b7274f48f0a4f9cb467ccb4573b1052='0',num_proj_1d356250256a467bbaf8c426158abae7='0',num_proj_21f218c3b73046bda1ac458019183605='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_3fdbb5e7bc98478b8346c4de35a059f3='0',num_proj_4632fed38799437594e5019a85a7bf81='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_82d442a1227e4368a2f74c32503387d5='0',num_proj_887c3104a0114851982023ae4f923f34='0',num_proj_a71c30f298e84c1abc9921bbe550773e='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:13Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 740.640829] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 740.641811] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 740.641811] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 740.641811] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.642019] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 740.642587] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.642712] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.642826] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.642996] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.643170] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.644324] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.644324] nova-scheduler[51486]: DEBUG nova.filters [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.644324] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 740.644324] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 740.644488] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Attempting to claim resources in the placement API for instance 3b30863b-8dc5-43e1-a222-ddcc6945af5f {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 740.731476] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] [instance: 3b30863b-8dc5-43e1-a222-ddcc6945af5f] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 740.731773] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.734983] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.003s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.735339] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-0be3ff61-e611-440f-b4e3-a36f7ef9627a tempest-ServersTestMultiNic-1670011942 tempest-ServersTestMultiNic-1670011942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 741.727872] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Starting to schedule for instances: ['441810a5-3977-4c39-9c4f-3157678196a2'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 741.728111] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 741.728724] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 741.728724] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 741.728724] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 741.729016] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 741.772497] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 741.772726] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 741.772886] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 741.779354] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 741.779557] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 741.779903] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='30',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='1',num_task_spawning='5',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:15Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 741.780190] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 741.780356] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 741.780508] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 741.780667] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 741.780907] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 741.781121] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.781299] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.781489] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.781651] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.781806] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.781963] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.782157] nova-scheduler[51488]: DEBUG nova.filters [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 741.782352] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 741.782470] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 741.782640] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Attempting to claim resources in the placement API for instance 441810a5-3977-4c39-9c4f-3157678196a2 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 741.831288] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] [instance: 441810a5-3977-4c39-9c4f-3157678196a2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 741.831537] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 741.832322] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 741.832539] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a44ad4a9-9c1e-4381-bac3-dfd510db967e tempest-ImagesOneServerTestJSON-572550516 tempest-ImagesOneServerTestJSON-572550516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.400244] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting to schedule for instances: ['eaeb9be3-b904-4e62-8ed3-301829c6a2ab', 'ec3f2585-2dff-4bd8-97b9-ad9357835761'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 742.400244] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 742.400244] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.400244] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.401319] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.401667] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 742.462603] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.462603] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.462603] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.468275] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.468505] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.468888] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='30',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='1',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='1',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='1',num_task_None='1',num_task_spawning='5',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:15Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 742.469242] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 742.469414] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 742.469577] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 742.469752] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.470019] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.470225] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470430] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470645] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470814] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470975] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.471483] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.471672] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.472179] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.472371] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 742.472561] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Attempting to claim resources in the placement API for instance eaeb9be3-b904-4e62-8ed3-301829c6a2ab {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 742.521132] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] [instance: eaeb9be3-b904-4e62-8ed3-301829c6a2ab] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 742.521447] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.521654] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.522485] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.522573] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.522699] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.522896] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.523036] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.523238] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 742.523394] nova-scheduler[51486]: DEBUG nova.scheduler.utils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Attempting to claim resources in the placement API for instance ec3f2585-2dff-4bd8-97b9-ad9357835761 {{(pid=51486) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 742.575076] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] [instance: ec3f2585-2dff-4bd8-97b9-ad9357835761] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51486) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 742.575427] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.575701] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.575922] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.576117] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.576338] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.576522] nova-scheduler[51486]: DEBUG nova.filters [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.576679] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.576851] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-512921ac-f802-4d63-8c8d-db93d3e05776 tempest-MultipleCreateTestJSON-1364053262 tempest-MultipleCreateTestJSON-1364053262-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 746.877058] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting to schedule for instances: ['38811b76-3497-44ff-8569-fb1e5c3952bf'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 746.877352] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 746.877570] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.877674] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.877926] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.879468] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 746.928466] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.928721] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.928890] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.936505] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.936780] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.937097] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='31',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_7c893f5f02774f5d8968f0ab9350daa1='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='2',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='4',num_task_spawning='2',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:18Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 746.937370] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 746.937534] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 746.937687] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 746.937844] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.938098] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 746.938302] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.938538] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.938662] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.938822] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.938978] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.939482] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.939576] nova-scheduler[51488]: DEBUG nova.filters [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.939737] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 746.939912] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 746.940092] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Attempting to claim resources in the placement API for instance 38811b76-3497-44ff-8569-fb1e5c3952bf {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 746.988238] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] [instance: 38811b76-3497-44ff-8569-fb1e5c3952bf] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 746.988538] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.988747] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.988938] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5ef7512a-93a3-4d28-ad05-ae1cb13d7e8d tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.468025] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['a7eb9d02-040d-4d39-b431-e22173bd4fa7'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 754.468335] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 754.468496] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 754.468672] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 754.469037] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 754.470560] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 754.524078] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.524317] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.524722] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.533889] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.533889] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.533889] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='34',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_7c893f5f02774f5d8968f0ab9350daa1='1',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='1',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='4',num_task_spawning='2',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:23Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=6) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 754.533889] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 754.533889] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 754.533889] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 754.533889] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.533889] nova-scheduler[51486]: DEBUG nova.filters [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 754.534477] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 67.380801 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 754.534477] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 754.534477] nova-scheduler[51486]: INFO nova.filters [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 0 hosts [ 754.534477] nova-scheduler[51486]: DEBUG nova.filters [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'a7eb9d02-040d-4d39-b431-e22173bd4fa7'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 754.534477] nova-scheduler[51486]: INFO nova.filters [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'a7eb9d02-040d-4d39-b431-e22173bd4fa7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 754.534477] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 754.534477] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-f994e27c-b359-4bea-85e7-1288831bfbff tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 757.894468] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Starting to schedule for instances: ['d764e5a8-acc6-40b0-b792-adfc3484aa08'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 757.894717] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 757.894755] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 757.894969] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 757.895192] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 757.895370] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 757.959826] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 757.960601] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 757.960601] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 757.970543] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 757.970674] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 757.970973] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='35',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='1',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='2',num_task_spawning='2',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:31Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 757.971790] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 757.971790] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 757.971790] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 757.971790] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 757.972112] nova-scheduler[51488]: DEBUG nova.filters [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 757.972203] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 70.820321 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 757.972366] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 757.972575] nova-scheduler[51488]: INFO nova.filters [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Filter ComputeFilter returned 0 hosts [ 757.973595] nova-scheduler[51488]: DEBUG nova.filters [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Filtering removed all hosts for the request with instance ID 'd764e5a8-acc6-40b0-b792-adfc3484aa08'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 757.973595] nova-scheduler[51488]: INFO nova.filters [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Filtering removed all hosts for the request with instance ID 'd764e5a8-acc6-40b0-b792-adfc3484aa08'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 757.973595] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 757.973595] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a2fac489-851f-4324-8856-f211902715f4 tempest-ServerAddressesTestJSON-359392322 tempest-ServerAddressesTestJSON-359392322-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 760.335834] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Starting to schedule for instances: ['60e2a8f4-691c-4e1c-bd66-dfe5293c52c9'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 760.336242] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 760.336425] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.336678] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.337031] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.337188] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 760.388522] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.388522] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.388522] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.397659] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.397659] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.397659] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='36',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='1',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='1',num_task_spawning='2',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:31Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=3) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 760.397659] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 760.397659] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 760.397659] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 760.397659] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.398036] nova-scheduler[51486]: DEBUG nova.filters [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 760.398036] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 73.246163 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 760.398156] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 760.398445] nova-scheduler[51486]: INFO nova.filters [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Filter ComputeFilter returned 0 hosts [ 760.398679] nova-scheduler[51486]: DEBUG nova.filters [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Filtering removed all hosts for the request with instance ID '60e2a8f4-691c-4e1c-bd66-dfe5293c52c9'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 760.398734] nova-scheduler[51486]: INFO nova.filters [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Filtering removed all hosts for the request with instance ID '60e2a8f4-691c-4e1c-bd66-dfe5293c52c9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 760.399538] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 760.399538] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-2d246f04-f205-47e8-b47d-c246e1768783 tempest-ServerShowV254Test-1373191504 tempest-ServerShowV254Test-1373191504-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 761.359143] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting to schedule for instances: ['d1a1116c-315d-4d43-9769-648073bcf618'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 761.359143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 761.359143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.359143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.359143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.359143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 761.418060] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.418060] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.418060] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.424446] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.424649] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.425106] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 761.425406] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 761.425565] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 761.425731] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 761.425905] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.426895] nova-scheduler[51488]: DEBUG nova.filters [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 761.426895] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 74.274545 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 761.426895] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 761.426895] nova-scheduler[51488]: INFO nova.filters [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filter ComputeFilter returned 0 hosts [ 761.426895] nova-scheduler[51488]: DEBUG nova.filters [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'd1a1116c-315d-4d43-9769-648073bcf618'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 761.427856] nova-scheduler[51488]: INFO nova.filters [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtering removed all hosts for the request with instance ID 'd1a1116c-315d-4d43-9769-648073bcf618'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 761.427856] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 761.427856] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fccef03-3938-4258-bc7a-170d1e170f21 tempest-DeleteServersTestJSON-824782706 tempest-DeleteServersTestJSON-824782706-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 762.571481] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Starting to schedule for instances: ['fbcc312d-b1f5-434b-94b0-1eb61b89176c'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 762.572171] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 762.572393] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.572584] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.572782] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.572953] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 762.622079] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.622397] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.622575] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.630167] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.630167] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.630167] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 762.630348] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 762.630503] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 762.630652] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 762.630808] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.631460] nova-scheduler[51486]: DEBUG nova.filters [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 762.631460] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 75.479449 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 762.631460] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 762.631596] nova-scheduler[51486]: INFO nova.filters [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Filter ComputeFilter returned 0 hosts [ 762.631969] nova-scheduler[51486]: DEBUG nova.filters [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Filtering removed all hosts for the request with instance ID 'fbcc312d-b1f5-434b-94b0-1eb61b89176c'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 762.631969] nova-scheduler[51486]: INFO nova.filters [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Filtering removed all hosts for the request with instance ID 'fbcc312d-b1f5-434b-94b0-1eb61b89176c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 762.631969] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 762.632118] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-c815dfce-7e7d-4205-9a42-6f9417f21ac1 tempest-ServerRescueTestJSONUnderV235-2077278578 tempest-ServerRescueTestJSONUnderV235-2077278578-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 765.879277] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Starting to schedule for instances: ['1d35faf5-024d-435c-b79a-c69ca146d21f'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 765.879277] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 765.879277] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.879277] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.879927] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.880323] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 765.928821] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.929192] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.929428] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.935919] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.936205] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.938123] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 765.939102] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 765.939346] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 765.939558] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 765.940141] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.004s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.940465] nova-scheduler[51488]: DEBUG nova.filters [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 765.940996] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 78.789119 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 765.941240] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 765.941452] nova-scheduler[51488]: INFO nova.filters [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filter ComputeFilter returned 0 hosts [ 765.941664] nova-scheduler[51488]: DEBUG nova.filters [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filtering removed all hosts for the request with instance ID '1d35faf5-024d-435c-b79a-c69ca146d21f'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 765.941854] nova-scheduler[51488]: INFO nova.filters [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filtering removed all hosts for the request with instance ID '1d35faf5-024d-435c-b79a-c69ca146d21f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 765.942077] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 765.942385] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-60c3cace-846a-43d1-9bc8-260053fbf14a tempest-SecurityGroupsTestJSON-1311240703 tempest-SecurityGroupsTestJSON-1311240703-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 766.259953] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting to schedule for instances: ['d52c6d74-a7ed-4799-b88b-05454b263287'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 766.260260] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 766.260414] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.260583] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.260775] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.260959] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 766.309400] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.309640] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.309807] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.318549] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.318549] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.318935] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 766.319238] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 766.319401] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 766.319550] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 766.319708] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.319963] nova-scheduler[51486]: DEBUG nova.filters [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 766.320183] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 79.168351 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 766.320618] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 766.320618] nova-scheduler[51486]: INFO nova.filters [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeFilter returned 0 hosts [ 766.320751] nova-scheduler[51486]: DEBUG nova.filters [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtering removed all hosts for the request with instance ID 'd52c6d74-a7ed-4799-b88b-05454b263287'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 766.320978] nova-scheduler[51486]: INFO nova.filters [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtering removed all hosts for the request with instance ID 'd52c6d74-a7ed-4799-b88b-05454b263287'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 766.321182] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 766.321375] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-fb2f70b6-9439-41a6-95d5-bff3b91fecae tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.882952] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['3f44ba4d-7913-47dc-be84-eef6758a7464'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.882952] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.883685] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.884171] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.887018] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.887018] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.947853] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.947853] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.947853] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.959225] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.959225] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.959359] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.959639] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.960070] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.960070] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.960207] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.960371] nova-scheduler[51488]: DEBUG nova.filters [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.960581] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 80.808748 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.961339] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 767.961339] nova-scheduler[51488]: INFO nova.filters [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 767.961339] nova-scheduler[51488]: DEBUG nova.filters [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '3f44ba4d-7913-47dc-be84-eef6758a7464'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.961339] nova-scheduler[51488]: INFO nova.filters [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '3f44ba4d-7913-47dc-be84-eef6758a7464'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.961339] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.961538] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-473eaefc-c375-452b-ad0d-8d6b325627ba tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 769.382022] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Starting to schedule for instances: ['00a35299-338b-473d-a4a0-b58578a6ea5a'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 769.382022] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 769.382022] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.382022] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.382022] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.385923] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 769.429929] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.430364] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.430490] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.437358] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.438012] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.438012] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 769.438364] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 769.438558] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 769.438744] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 769.438934] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.439230] nova-scheduler[51486]: DEBUG nova.filters [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 769.439498] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 82.287632 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 769.439685] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 769.441170] nova-scheduler[51486]: INFO nova.filters [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Filter ComputeFilter returned 0 hosts [ 769.441170] nova-scheduler[51486]: DEBUG nova.filters [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Filtering removed all hosts for the request with instance ID '00a35299-338b-473d-a4a0-b58578a6ea5a'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 769.441170] nova-scheduler[51486]: INFO nova.filters [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Filtering removed all hosts for the request with instance ID '00a35299-338b-473d-a4a0-b58578a6ea5a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 769.441170] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 769.441170] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-799e0132-9ce7-45f6-ba16-7262f3f4ca70 tempest-AttachInterfacesV270Test-345564379 tempest-AttachInterfacesV270Test-345564379-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.390422] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Starting to schedule for instances: ['1f7884a5-5aca-46ab-893f-84f1d369bee1'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.390698] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.390854] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.391194] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.391439] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.391624] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.435994] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.436238] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.436401] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.442505] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.442710] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.443199] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.443478] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.443646] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.443796] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.443956] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.444223] nova-scheduler[51488]: DEBUG nova.filters [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.444425] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 83.292598 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.444575] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 770.444720] nova-scheduler[51488]: INFO nova.filters [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Filter ComputeFilter returned 0 hosts [ 770.444873] nova-scheduler[51488]: DEBUG nova.filters [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Filtering removed all hosts for the request with instance ID '1f7884a5-5aca-46ab-893f-84f1d369bee1'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.445031] nova-scheduler[51488]: INFO nova.filters [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Filtering removed all hosts for the request with instance ID '1f7884a5-5aca-46ab-893f-84f1d369bee1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.445176] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.445359] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-84825954-cc3f-4ef6-a85b-af1afe6097e8 tempest-ServersV294TestFqdnHostnames-1902615931 tempest-ServersV294TestFqdnHostnames-1902615931-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 771.030349] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting to schedule for instances: ['ad52ca55-6de4-4c0e-bb6e-22b32ea5277e'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 771.030349] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 771.030349] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 771.030654] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 771.030654] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 771.032024] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 771.081845] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 771.082093] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 771.082266] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 771.092925] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 771.092925] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 771.093158] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 771.093426] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 771.094308] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 771.094308] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 771.094308] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 771.094308] nova-scheduler[51486]: DEBUG nova.filters [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 771.094597] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 83.942563 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 771.094597] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 771.094666] nova-scheduler[51486]: INFO nova.filters [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeFilter returned 0 hosts [ 771.094813] nova-scheduler[51486]: DEBUG nova.filters [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtering removed all hosts for the request with instance ID 'ad52ca55-6de4-4c0e-bb6e-22b32ea5277e'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 771.094947] nova-scheduler[51486]: INFO nova.filters [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtering removed all hosts for the request with instance ID 'ad52ca55-6de4-4c0e-bb6e-22b32ea5277e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 771.095115] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 771.095518] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-800b3b2c-143d-44b2-9545-1fe62a3fb4f4 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 772.200552] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['f31dda31-d1fa-43ee-a7f4-aa5a1ce248b6'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 772.200805] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 772.200898] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.201291] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.201562] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.201725] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 772.254997] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.255359] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.255444] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.265477] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.266155] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.266676] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 772.267536] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 772.269125] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 772.269125] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 772.269125] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.269125] nova-scheduler[51488]: DEBUG nova.filters [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 772.269125] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 85.117109 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 772.269125] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 772.269360] nova-scheduler[51488]: INFO nova.filters [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 772.269392] nova-scheduler[51488]: DEBUG nova.filters [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID 'f31dda31-d1fa-43ee-a7f4-aa5a1ce248b6'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 772.269508] nova-scheduler[51488]: INFO nova.filters [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID 'f31dda31-d1fa-43ee-a7f4-aa5a1ce248b6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 772.270164] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 772.270164] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-09e14e2c-1903-4347-8eef-68b11f5b79e0 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 773.864925] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['4aa40f7e-4257-429e-953f-494a91b5d345'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 773.865233] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 773.865390] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 773.865568] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 773.865756] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 773.865958] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 773.920188] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 773.920427] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 773.920666] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 773.927455] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 773.927629] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 773.927979] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 773.928265] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 773.928430] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 773.928580] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 773.928781] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 773.929130] nova-scheduler[51486]: DEBUG nova.filters [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 773.932117] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 86.777516 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 773.932117] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 773.932117] nova-scheduler[51486]: INFO nova.filters [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 773.932117] nova-scheduler[51486]: DEBUG nova.filters [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '4aa40f7e-4257-429e-953f-494a91b5d345'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 773.932117] nova-scheduler[51486]: INFO nova.filters [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '4aa40f7e-4257-429e-953f-494a91b5d345'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 773.932117] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 773.932117] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-b5319dcb-17d9-47b9-837d-70a88de40b8e tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 774.776126] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting to schedule for instances: ['18222cd0-f996-4439-bb14-d86c85cfccb2'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 774.776533] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 774.776533] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.776728] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.777143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.777143] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 774.822998] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 774.823234] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 774.823459] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.831476] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 774.831476] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 774.831476] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 774.831476] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 774.831476] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 774.831476] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 774.831476] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.832272] nova-scheduler[51488]: DEBUG nova.filters [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 774.832272] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 87.679942 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 774.832272] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 774.832272] nova-scheduler[51488]: INFO nova.filters [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filter ComputeFilter returned 0 hosts [ 774.832272] nova-scheduler[51488]: DEBUG nova.filters [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtering removed all hosts for the request with instance ID '18222cd0-f996-4439-bb14-d86c85cfccb2'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 774.832445] nova-scheduler[51488]: INFO nova.filters [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtering removed all hosts for the request with instance ID '18222cd0-f996-4439-bb14-d86c85cfccb2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 774.832588] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 774.832740] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-36027aa7-80a7-4568-99fd-fe31fdf6d620 tempest-ServerDiskConfigTestJSON-1220714776 tempest-ServerDiskConfigTestJSON-1220714776-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 775.204858] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Starting to schedule for instances: ['2a2cdceb-508c-49e5-896a-650724229703'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 775.205194] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 775.205500] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.205698] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.205903] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.206365] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 775.256494] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.256727] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.256946] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.263739] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.263928] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.264344] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 775.264575] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 775.264744] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 775.264896] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 775.265135] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.265324] nova-scheduler[51486]: DEBUG nova.filters [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 775.265532] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 88.113703 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 775.265689] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 775.265960] nova-scheduler[51486]: INFO nova.filters [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Filter ComputeFilter returned 0 hosts [ 775.266053] nova-scheduler[51486]: DEBUG nova.filters [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Filtering removed all hosts for the request with instance ID '2a2cdceb-508c-49e5-896a-650724229703'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 775.266165] nova-scheduler[51486]: INFO nova.filters [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Filtering removed all hosts for the request with instance ID '2a2cdceb-508c-49e5-896a-650724229703'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 775.266316] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 775.266457] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-85440e39-9427-4d3a-a8c6-9f1483f469eb tempest-ServersNegativeTestJSON-1504060092 tempest-ServersNegativeTestJSON-1504060092-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 777.101504] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['17bea248-b4a0-4c5d-ab4c-96386aae1c21'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 777.101504] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 777.104331] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.104641] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.104860] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.105075] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 777.168178] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 777.169620] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 777.169956] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 777.184526] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 777.184783] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 777.185168] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 777.185443] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 777.185603] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 777.185748] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 777.185914] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 777.186224] nova-scheduler[51488]: DEBUG nova.filters [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 777.186430] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 90.034602 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 777.186574] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 777.186720] nova-scheduler[51488]: INFO nova.filters [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 777.186902] nova-scheduler[51488]: DEBUG nova.filters [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '17bea248-b4a0-4c5d-ab4c-96386aae1c21'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 777.187098] nova-scheduler[51488]: INFO nova.filters [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '17bea248-b4a0-4c5d-ab4c-96386aae1c21'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 777.187270] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 777.187465] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-49cb895e-efb8-49a0-9972-96926fd1de0b tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 780.099175] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['dd10be93-1e3d-49d6-abfe-b298b1b947d4'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 780.099583] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 780.099753] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.099930] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.100139] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.100319] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 780.155842] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.156120] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.156313] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.164650] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.164861] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.165235] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 780.165514] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 780.165675] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 780.165825] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 780.165979] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.166279] nova-scheduler[51486]: DEBUG nova.filters [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 780.166488] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 93.014658 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 780.166638] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 780.166789] nova-scheduler[51486]: INFO nova.filters [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 780.166929] nova-scheduler[51486]: DEBUG nova.filters [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID 'dd10be93-1e3d-49d6-abfe-b298b1b947d4'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 780.167968] nova-scheduler[51486]: INFO nova.filters [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID 'dd10be93-1e3d-49d6-abfe-b298b1b947d4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 780.167968] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 780.167968] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-3a6b30d0-00b1-4085-a402-8dec1ecc7e78 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 782.654632] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['336f67d2-023b-4594-8a39-c3fd4d1d2986'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 782.656169] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 782.656169] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.656169] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.656491] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.656728] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 782.704277] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 782.704766] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 782.705013] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 782.716869] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 782.717105] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 782.717487] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 782.717759] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 782.717922] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 782.718088] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 782.718251] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 782.718533] nova-scheduler[51488]: DEBUG nova.filters [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 782.718751] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 95.566914 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 782.718905] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 782.719539] nova-scheduler[51488]: INFO nova.filters [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 782.719875] nova-scheduler[51488]: DEBUG nova.filters [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '336f67d2-023b-4594-8a39-c3fd4d1d2986'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 782.719875] nova-scheduler[51488]: INFO nova.filters [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '336f67d2-023b-4594-8a39-c3fd4d1d2986'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 782.720826] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 782.720826] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-54ec9d3f-ad53-4027-8ea4-cd14282b58e1 tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 783.681422] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Starting to schedule for instances: ['c6836788-fc59-44db-bf09-ca06dc727e84'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 783.681714] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 783.681887] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.685756] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.686699] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.686699] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 783.749017] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.749017] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.749017] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.753668] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.753860] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.754274] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 783.754668] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 783.754705] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 783.754847] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 783.755029] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.755272] nova-scheduler[51486]: DEBUG nova.filters [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 783.755483] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 96.603654 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 783.755634] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 783.755780] nova-scheduler[51486]: INFO nova.filters [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Filter ComputeFilter returned 0 hosts [ 783.757009] nova-scheduler[51486]: DEBUG nova.filters [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Filtering removed all hosts for the request with instance ID 'c6836788-fc59-44db-bf09-ca06dc727e84'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 783.757009] nova-scheduler[51486]: INFO nova.filters [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Filtering removed all hosts for the request with instance ID 'c6836788-fc59-44db-bf09-ca06dc727e84'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 783.757009] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 783.757009] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-d4dba6cc-2e37-4566-a8b1-e8841541762f tempest-InstanceActionsV221TestJSON-1807206177 tempest-InstanceActionsV221TestJSON-1807206177-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 784.022725] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Starting to schedule for instances: ['92e4993f-3cb9-4bbd-93a6-7c263f7ed353'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 784.023508] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 784.023508] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.023508] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.024819] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.024909] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 784.072738] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.073153] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.073457] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.082079] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.082079] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.082644] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 784.082644] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 784.082809] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 784.082878] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 784.084444] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.084444] nova-scheduler[51488]: DEBUG nova.filters [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 784.084444] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 96.931817 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 784.084444] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 784.084444] nova-scheduler[51488]: INFO nova.filters [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filter ComputeFilter returned 0 hosts [ 784.084444] nova-scheduler[51488]: DEBUG nova.filters [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtering removed all hosts for the request with instance ID '92e4993f-3cb9-4bbd-93a6-7c263f7ed353'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 784.084444] nova-scheduler[51488]: INFO nova.filters [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtering removed all hosts for the request with instance ID '92e4993f-3cb9-4bbd-93a6-7c263f7ed353'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 784.084444] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 784.084932] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6b2ed89a-7724-4362-b14b-fc00798e46f7 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 784.759868] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Starting to schedule for instances: ['dbfcbed6-7818-4c55-b45e-eccb2142bc41'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 784.760178] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 784.760315] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.760489] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.760677] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.760894] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 784.813728] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.813968] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.814149] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.824789] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.825038] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.825418] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 784.825691] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 784.825853] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 784.826008] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 784.826297] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.826559] nova-scheduler[51486]: DEBUG nova.filters [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 784.826814] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 97.67495 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 784.826960] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 784.827573] nova-scheduler[51486]: INFO nova.filters [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filter ComputeFilter returned 0 hosts [ 784.827573] nova-scheduler[51486]: DEBUG nova.filters [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filtering removed all hosts for the request with instance ID 'dbfcbed6-7818-4c55-b45e-eccb2142bc41'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 784.827573] nova-scheduler[51486]: INFO nova.filters [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filtering removed all hosts for the request with instance ID 'dbfcbed6-7818-4c55-b45e-eccb2142bc41'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 784.827573] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 784.827856] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-7cb46865-bf93-45dc-97de-2fd3b7f6167f tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 785.311498] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting to schedule for instances: ['2f5b3dde-7a94-495e-bf6f-1576b0ad93b2'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 785.311498] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 785.311498] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 785.311498] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 785.313165] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 785.313549] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 785.372972] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 785.372972] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 785.372972] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 785.379595] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 785.379823] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 785.380204] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='38',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='2',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:48:34Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 785.380488] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 785.380652] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 785.380801] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 785.380960] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 785.381265] nova-scheduler[51488]: DEBUG nova.filters [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 785.381494] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 98.229647 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 785.381663] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 785.381815] nova-scheduler[51488]: INFO nova.filters [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filter ComputeFilter returned 0 hosts [ 785.381958] nova-scheduler[51488]: DEBUG nova.filters [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '2f5b3dde-7a94-495e-bf6f-1576b0ad93b2'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 785.382455] nova-scheduler[51488]: INFO nova.filters [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtering removed all hosts for the request with instance ID '2f5b3dde-7a94-495e-bf6f-1576b0ad93b2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 785.382634] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 785.382813] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bc068f07-e595-4469-bba3-6b048a47cbeb tempest-ServersTestJSON-1479251508 tempest-ServersTestJSON-1479251508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 790.673632] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Starting to schedule for instances: ['09321841-4639-496f-b6cd-69afbc77821c'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 790.673939] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 790.674106] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.674278] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.674464] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.674638] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 790.721086] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.721534] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.721534] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.729187] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.730137] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.730137] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 790.730137] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 790.730137] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 790.730352] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 790.730390] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.730629] nova-scheduler[51486]: DEBUG nova.filters [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 790.730807] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 103.578984 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 790.730958] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 790.731196] nova-scheduler[51486]: INFO nova.filters [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filter ComputeFilter returned 0 hosts [ 790.731768] nova-scheduler[51486]: DEBUG nova.filters [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filtering removed all hosts for the request with instance ID '09321841-4639-496f-b6cd-69afbc77821c'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 790.731768] nova-scheduler[51486]: INFO nova.filters [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filtering removed all hosts for the request with instance ID '09321841-4639-496f-b6cd-69afbc77821c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 790.731768] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 790.731768] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-8d7d4747-f2c7-49b2-907a-0dbe0e3983c1 tempest-AttachVolumeShelveTestJSON-738446686 tempest-AttachVolumeShelveTestJSON-738446686-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 790.754595] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Starting to schedule for instances: ['038fba08-e1a7-4a4c-bd36-fdcd8985a044'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 790.754873] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 790.755193] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.757079] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.757079] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.757079] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 790.800206] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.800206] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.800206] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.807043] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.807270] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.807632] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 790.807945] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 790.808133] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 790.808287] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 790.808448] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.808720] nova-scheduler[51488]: DEBUG nova.filters [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 790.808932] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 103.657099 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 790.809139] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 790.809355] nova-scheduler[51488]: INFO nova.filters [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filter ComputeFilter returned 0 hosts [ 790.809461] nova-scheduler[51488]: DEBUG nova.filters [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtering removed all hosts for the request with instance ID '038fba08-e1a7-4a4c-bd36-fdcd8985a044'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 790.809595] nova-scheduler[51488]: INFO nova.filters [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtering removed all hosts for the request with instance ID '038fba08-e1a7-4a4c-bd36-fdcd8985a044'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 790.809740] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 790.809882] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0c5888a8-e2ae-4a59-8e99-a7294a8d4be4 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 791.192616] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Starting to schedule for instances: ['1bc433f7-f2f4-4f10-b185-c2f4e3798451'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 791.193071] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 791.193660] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.196861] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.196861] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.196861] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 791.224422] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Starting to schedule for instances: ['98ec7184-ffea-47f7-b3fd-b308546d70ae'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 791.224930] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 791.224930] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.225057] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.225238] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.225408] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 791.244456] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 791.244456] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 791.244456] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 791.251037] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 791.251333] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 791.251720] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 791.252036] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 791.252255] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 791.252442] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 791.252629] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 791.252906] nova-scheduler[51486]: DEBUG nova.filters [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 791.253152] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 104.101302 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 791.253346] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 791.253522] nova-scheduler[51486]: INFO nova.filters [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Filter ComputeFilter returned 0 hosts [ 791.253693] nova-scheduler[51486]: DEBUG nova.filters [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Filtering removed all hosts for the request with instance ID '1bc433f7-f2f4-4f10-b185-c2f4e3798451'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 791.253865] nova-scheduler[51486]: INFO nova.filters [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Filtering removed all hosts for the request with instance ID '1bc433f7-f2f4-4f10-b185-c2f4e3798451'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 791.254070] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 791.254270] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-be23ed42-8b3f-490f-94b7-978039e0df2f tempest-ServerRescueTestJSON-563858412 tempest-ServerRescueTestJSON-563858412-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 791.279917] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 791.279917] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 791.279917] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 791.286727] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 791.286950] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 791.287317] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 791.287620] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 791.287791] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 791.287941] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 791.288128] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 791.288380] nova-scheduler[51488]: DEBUG nova.filters [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 791.288727] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 104.136757 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 791.288727] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 791.288862] nova-scheduler[51488]: INFO nova.filters [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Filter ComputeFilter returned 0 hosts [ 791.289017] nova-scheduler[51488]: DEBUG nova.filters [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Filtering removed all hosts for the request with instance ID '98ec7184-ffea-47f7-b3fd-b308546d70ae'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 791.289157] nova-scheduler[51488]: INFO nova.filters [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Filtering removed all hosts for the request with instance ID '98ec7184-ffea-47f7-b3fd-b308546d70ae'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 791.289300] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 791.289454] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-8162526d-23ad-43c3-82ec-bd8efe78f466 tempest-ServersAaction247Test-911165096 tempest-ServersAaction247Test-911165096-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 794.795155] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Starting to schedule for instances: ['e07f3798-9e45-47b1-ba48-6ddf57e0b291'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 794.795495] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 794.795652] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.795793] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.795990] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.797160] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 794.841372] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.841588] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.841754] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.848700] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.848914] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.849289] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 794.849561] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 794.849724] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 794.849874] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Update host state with instances: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 794.850051] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.850312] nova-scheduler[51486]: DEBUG nova.filters [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 794.850505] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 107.698678 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 794.850656] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 794.850801] nova-scheduler[51486]: INFO nova.filters [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filter ComputeFilter returned 0 hosts [ 794.850946] nova-scheduler[51486]: DEBUG nova.filters [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtering removed all hosts for the request with instance ID 'e07f3798-9e45-47b1-ba48-6ddf57e0b291'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 794.851093] nova-scheduler[51486]: INFO nova.filters [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtering removed all hosts for the request with instance ID 'e07f3798-9e45-47b1-ba48-6ddf57e0b291'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 794.851237] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 794.851378] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-21567a75-764b-4f13-9735-a9d914d39266 tempest-AttachVolumeNegativeTest-1516761174 tempest-AttachVolumeNegativeTest-1516761174-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 797.004691] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Starting to schedule for instances: ['a44b9569-f779-4d13-8aa1-bdc658fe7f7d'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 797.008020] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 797.008020] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 797.008020] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 797.008020] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 797.008020] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 797.069016] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 797.069016] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 797.069016] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 797.073761] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 797.073968] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 797.074398] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 797.074788] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 797.074957] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 797.075120] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 797.075280] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 797.075528] nova-scheduler[51488]: DEBUG nova.filters [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 797.079018] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 109.923909 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 797.079018] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 797.079018] nova-scheduler[51488]: INFO nova.filters [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filter ComputeFilter returned 0 hosts [ 797.079018] nova-scheduler[51488]: DEBUG nova.filters [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filtering removed all hosts for the request with instance ID 'a44b9569-f779-4d13-8aa1-bdc658fe7f7d'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 797.079018] nova-scheduler[51488]: INFO nova.filters [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filtering removed all hosts for the request with instance ID 'a44b9569-f779-4d13-8aa1-bdc658fe7f7d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 797.079018] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 797.079018] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-4f976ffd-f09d-4272-bdd1-f11a449f427c tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 798.719700] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.719948] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.720137] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.720199] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.720289] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.720443] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.720483] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.720636] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.720686] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.720801] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.723750] nova-scheduler[51488]: INFO nova.scheduler.host_manager [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 798.723927] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.724029] nova-scheduler[51486]: INFO nova.scheduler.host_manager [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 798.724250] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-810b5f1b-be5b-42af-939f-852fd72eeb0f None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.822604] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Starting to schedule for instances: ['fbdb180b-1c8f-4f59-8c71-aff99a1439e8'] {{(pid=51486) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 799.822894] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51486) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 799.823043] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 799.823223] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 799.823409] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51486) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 799.823582] nova-scheduler[51486]: DEBUG nova.scheduler.request_filter [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] ephemeral_encryption_filter skipped {{(pid=51486) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 799.937786] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 799.938593] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 799.938593] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.944818] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 799.944818] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 799.944818] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.946827] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 799.947112] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 799.947792] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='39',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_06f260ca811e4dada55813b2b8656839='0',num_proj_0c0b17586dcd47b9b08c331a00083433='0',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_proj_4632fed38799437594e5019a85a7bf81='0',num_proj_61fe8d56a7ce444e87d2e7743b3a961f='0',num_proj_7c893f5f02774f5d8968f0ab9350daa1='0',num_proj_b53e0ad3e7a2485ba3547c57d84748ef='0',num_proj_e63775eb8bc34a52a2b1e79624c417e8='0',num_proj_f07a595f0d54471b9b09e9b1b9b0b5a5='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:02Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 799.947919] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state with aggregates: [] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 799.948049] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 47, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 799.948200] nova-scheduler[51486]: DEBUG nova.scheduler.host_manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Update host state with instances: ['1d6fb105-7087-4bdf-9b1c-b194baf39a55'] {{(pid=51486) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 799.948356] nova-scheduler[51486]: DEBUG oslo_concurrency.lockutils [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51486) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.948611] nova-scheduler[51486]: DEBUG nova.filters [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Starting with 1 host(s) {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 799.948820] nova-scheduler[51486]: DEBUG nova.servicegroup.drivers.db [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-16 19:47:21. Elapsed time is 112.796988 {{(pid=51486) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 799.948969] nova-scheduler[51486]: WARNING nova.scheduler.filters.compute_filter [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 799.949133] nova-scheduler[51486]: INFO nova.filters [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filter ComputeFilter returned 0 hosts [ 799.950119] nova-scheduler[51486]: DEBUG nova.filters [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filtering removed all hosts for the request with instance ID 'fbdb180b-1c8f-4f59-8c71-aff99a1439e8'. Filter results: [('ComputeFilter', None)] {{(pid=51486) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 799.950119] nova-scheduler[51486]: INFO nova.filters [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filtering removed all hosts for the request with instance ID 'fbdb180b-1c8f-4f59-8c71-aff99a1439e8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 799.950119] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] Filtered [] {{(pid=51486) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 799.950119] nova-scheduler[51486]: DEBUG nova.scheduler.manager [None req-04a7c544-b55d-463a-866d-ba02e55586c4 tempest-AttachVolumeTestJSON-2075379818 tempest-AttachVolumeTestJSON-2075379818-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51486) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 808.213263] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Starting to schedule for instances: ['a6df92d0-111a-4350-9aec-97c2fbaa98d0'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 808.213512] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 808.213628] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 808.213808] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 808.214010] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 808.214207] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 808.251340] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 808.251556] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 808.251720] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 808.258100] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Acquiring lock "43d564f7-5143-479a-991c-c11659f6272d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 808.258299] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 808.258462] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "43d564f7-5143-479a-991c-c11659f6272d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 808.260384] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 808.260572] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 808.260911] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-16T19:45:16Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='40',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_353be627d6be43b0a2cb6bc48c77b78f='1',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-16T19:49:14Z,uuid=7c9b9790-f1a0-47dd-a54c-c74c172308d9,vcpus=48,vcpus_used=1) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 808.261201] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 808.261365] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Update host state with service dict: {'id': 8, 'uuid': 'b8194795-8d78-46c9-8add-37bf76f1d889', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 16, 19, 49, 21, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 16, 19, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 16, 19, 49, 21, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 808.261517] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Update host state with instances: ['1d6fb105-7087-4bdf-9b1c-b194baf39a55'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 808.261684] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 808.261927] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 808.262133] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.262312] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.262502] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.262665] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.262822] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.262985] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.263181] nova-scheduler[51488]: DEBUG nova.filters [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 808.263347] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 808.263509] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 808.263680] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Attempting to claim resources in the placement API for instance a6df92d0-111a-4350-9aec-97c2fbaa98d0 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 808.314271] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] [instance: a6df92d0-111a-4350-9aec-97c2fbaa98d0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 808.314631] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 808.314842] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 808.315048] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80ec4edb-8b27-47f7-a3f4-ea69798bd613 tempest-ServerActionsV293TestJSON-1617646457 tempest-ServerActionsV293TestJSON-1617646457-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}