[ 459.474741] nova-scheduler[51137]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 460.536162] nova-scheduler[51137]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 460.547008] nova-scheduler[51137]: DEBUG oslo_db.sqlalchemy.engines [None req-e289b1ac-106b-4a1d-ba84-dc6f760d15a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51137) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 460.659510] nova-scheduler[51137]: DEBUG nova.scheduler.host_manager [None req-e289b1ac-106b-4a1d-ba84-dc6f760d15a1 None None] Found 1 cells: b5105805-148c-4545-8985-397f7b32e247 {{(pid=51137) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 460.659716] nova-scheduler[51137]: DEBUG nova.scheduler.host_manager [None req-e289b1ac-106b-4a1d-ba84-dc6f760d15a1 None None] Found 0 disabled cells: {{(pid=51137) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 460.688743] nova-scheduler[51137]: DEBUG nova.scheduler.host_manager [None req-e289b1ac-106b-4a1d-ba84-dc6f760d15a1 None None] START:_async_init_instance_info {{(pid=51137) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 460.690421] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 460.690630] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 460.691965] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 460.696943] nova-scheduler[51137]: DEBUG oslo_db.sqlalchemy.engines [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51137) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 460.705019] nova-scheduler[51137]: DEBUG nova.scheduler.host_manager [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Total number of compute nodes: 0 {{(pid=51137) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 460.705369] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 460.705577] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 460.705750] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 460.759017] nova-scheduler[51137]: DEBUG nova.scheduler.host_manager [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] Adding 0 instances for hosts 10-20 {{(pid=51137) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 460.759017] nova-scheduler[51137]: DEBUG nova.scheduler.host_manager [None req-55a78e35-b836-4f68-8592-0aef7dd3aace None None] END:_async_init_instance_info {{(pid=51137) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 460.786036] nova-scheduler[51137]: DEBUG nova.context [None req-e289b1ac-106b-4a1d-ba84-dc6f760d15a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b5105805-148c-4545-8985-397f7b32e247(cell1) {{(pid=51137) load_cells /opt/stack/nova/nova/context.py:464}} [ 460.786387] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 460.786583] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 460.787387] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 460.787636] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 460.787820] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 460.787972] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51137) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 460.794899] nova-scheduler[51137]: DEBUG oslo_db.sqlalchemy.engines [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51137) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 460.803017] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Acquiring lock "singleton_lock" {{(pid=51137) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 460.803017] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Acquired lock "singleton_lock" {{(pid=51137) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 460.803017] nova-scheduler[51137]: DEBUG oslo_concurrency.lockutils [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Releasing lock "singleton_lock" {{(pid=51137) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 460.803017] nova-scheduler[51137]: INFO oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Starting 2 workers [ 460.806758] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Started child 52181 {{(pid=51137) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 460.810026] nova-scheduler[52181]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 460.811219] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Started child 52185 {{(pid=51137) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 460.811884] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Full set of CONF: {{(pid=51137) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 460.812705] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ******************************************************************************** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 460.812705] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] Configuration options gathered from: {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 460.812705] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 460.812890] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] config files: ['/etc/nova/nova.conf'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 460.812935] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ================================================================================ {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 460.813419] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] allow_resize_to_same_host = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.814008] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] arq_binding_timeout = 300 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.814008] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] block_device_allocate_retries = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.814008] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] block_device_allocate_retries_interval = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.814191] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cert = self.pem {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.814283] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute_driver = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.814484] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute_monitors = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815156] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] config_dir = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815156] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] config_drive_format = iso9660 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815156] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815369] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] config_source = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815438] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] console_host = devstack {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815594] nova-scheduler[52185]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 460.815796] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] control_exchange = nova {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815796] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cpu_allocation_ratio = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.815958] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] daemon = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.816172] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] debug = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.816343] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] default_access_ip_network_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.816526] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] default_availability_zone = nova {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.816698] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] default_ephemeral_format = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.817195] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.817321] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] default_schedule_zone = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.817381] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] disk_allocation_ratio = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818094] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] enable_new_services = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818094] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] enabled_apis = ['osapi_compute'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818094] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] enabled_ssl_apis = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818276] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] flat_injected = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818358] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] force_config_drive = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818524] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] force_raw_images = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818708] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] graceful_shutdown_timeout = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.818866] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] heal_instance_info_cache_interval = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.819552] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] host = devstack {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.819635] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.819790] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] initial_disk_allocation_ratio = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.819978] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] initial_ram_allocation_ratio = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.820628] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.820628] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_build_timeout = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.820628] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_delete_interval = 300 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.820811] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_format = [instance: %(uuid)s] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.820929] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_name_template = instance-%08x {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.821532] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_usage_audit = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.821532] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_usage_audit_period = month {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.821532] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.821712] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] instances_path = /opt/stack/data/nova/instances {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.821853] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] internal_service_availability_zone = internal {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.822582] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] key = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.822582] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] live_migration_retry_count = 30 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.822778] nova-scheduler[52181]: DEBUG oslo_db.sqlalchemy.engines [None req-73ec4867-e207-4c63-8be0-7cb321c04716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52181) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 460.822848] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_config_append = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.822848] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.822848] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_dir = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823091] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823091] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_options = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823183] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_rotate_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823398] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_rotate_interval_type = days {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823585] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] log_rotation_type = none {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823713] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.823828] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.824024] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.824264] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.824354] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.824569] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] long_rpc_timeout = 1800 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825115] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] max_concurrent_builds = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825115] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] max_concurrent_live_migrations = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825115] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] max_concurrent_snapshots = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825277] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] max_local_block_devices = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825321] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] max_logfile_count = 30 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825481] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] max_logfile_size_mb = 200 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825648] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] maximum_instance_delete_attempts = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.825841] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metadata_listen = 0.0.0.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.826078] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metadata_listen_port = 8775 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.826250] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metadata_workers = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.826426] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] migrate_max_retries = -1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.826605] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] mkisofs_cmd = genisoimage {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.826862] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] my_block_storage_ip = 10.180.1.21 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.827049] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] my_ip = 10.180.1.21 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.827215] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] network_allocate_retries = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.827431] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.827606] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] osapi_compute_listen = 0.0.0.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.827812] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] osapi_compute_listen_port = 8774 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.827985] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] osapi_compute_unique_server_name_scope = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.828181] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] osapi_compute_workers = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.828358] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] password_length = 12 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.828522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] periodic_enable = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.828704] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] periodic_fuzzy_delay = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.828883] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] pointer_model = usbtablet {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.829083] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] preallocate_images = none {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.829245] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] publish_errors = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.829396] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] pybasedir = /opt/stack/nova {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.829560] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ram_allocation_ratio = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.829676] nova-scheduler[52185]: DEBUG oslo_db.sqlalchemy.engines [None req-c380d866-0d27-4661-9caa-2b73d8a0c6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52185) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 460.829927] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rate_limit_burst = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.829927] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rate_limit_except_level = CRITICAL {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.830079] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rate_limit_interval = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.830469] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reboot_timeout = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.830469] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reclaim_instance_interval = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.830572] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] record = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.830751] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reimage_timeout_per_gb = 20 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.830908] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] report_interval = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.831097] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rescue_timeout = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.831258] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reserved_host_cpus = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.831412] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reserved_host_disk_mb = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.831565] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reserved_host_memory_mb = 512 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.831760] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] reserved_huge_pages = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.831919] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] resize_confirm_window = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.832081] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] resize_fs_using_block_device = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.832244] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] resume_guests_state_on_host_boot = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.832418] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.832585] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] run_external_periodic_tasks = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.832767] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] running_deleted_instance_action = reap {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.832926] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] running_deleted_instance_poll_interval = 1800 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.833091] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] running_deleted_instance_timeout = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.833285] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler_instance_sync_interval = 120 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.833448] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_down_time = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.833962] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] servicegroup_driver = db {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.833962] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] shelved_offload_time = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.833962] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] shelved_poll_interval = 3600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.834160] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] shutdown_timeout = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.834295] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] source_is_ipv6 = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.834448] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ssl_only = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.834629] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] state_path = /opt/stack/data/nova {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.834787] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] sync_power_state_interval = 600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.834941] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] sync_power_state_pool_size = 1000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.835114] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] syslog_log_facility = LOG_USER {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.835272] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] tempdir = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.835423] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] timeout_nbd = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.835600] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] transport_url = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.835753] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] update_resources_interval = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.835906] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_cow_images = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.836090] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_eventlog = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.836295] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_journal = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.836471] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_json = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.836977] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_rootwrap_daemon = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.836977] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_stderr = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.836977] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] use_syslog = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.837156] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vcpu_pin_set = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.837317] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vif_plugging_is_fatal = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.837480] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vif_plugging_timeout = 300 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.837700] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] virt_mkfs = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.837896] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] volume_usage_poll_interval = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.838069] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] watch_log_file = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.838253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] web = /usr/share/spice-html5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 460.838556] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_concurrency.disable_process_locking = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.838959] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.839026] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.auth_strategy = keystone {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.839200] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.compute_link_prefix = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.839401] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.839594] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.dhcp_domain = novalocal {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.839772] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.enable_instance_password = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.839992] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.glance_link_prefix = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.840184] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.840374] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.840534] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.instance_list_per_project_cells = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.840696] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.list_records_by_skipping_down_cells = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.840874] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.local_metadata_per_cell = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.841071] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.max_limit = 1000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.841259] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.metadata_cache_expiration = 15 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.841450] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.neutron_default_tenant_id = default {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.841631] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.use_forwarded_for = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.841809] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.use_neutron_default_nets = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.842023] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.842283] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.842397] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.842624] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.842731] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_dynamic_targets = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.842890] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_jsonfile_path = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.843105] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.843354] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.backend = dogpile.cache.memcached {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.843549] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.backend_argument = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.843739] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.config_prefix = cache.oslo {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.843931] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.dead_timeout = 60.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.844133] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.debug_cache_backend = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.844278] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.enable_retry_client = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.844442] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.enable_socket_keepalive = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.844638] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.enabled = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845179] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.expiration_time = 600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845179] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.hashclient_retry_attempts = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845179] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.hashclient_retry_delay = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845436] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_dead_retry = 300 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845508] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_password = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845671] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.845830] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.846447] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_pool_maxsize = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.846447] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.846447] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_sasl_enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_socket_timeout = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.memcache_username = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.proxies = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.retry_attempts = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.retry_delay = 0.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.849691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.socket_keepalive_count = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.socket_keepalive_idle = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.socket_keepalive_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.tls_allowed_ciphers = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.tls_cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.tls_certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.tls_enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.850687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cache.tls_keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.auth_type = password {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.catalog_info = volumev3::publicURL {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.cross_az_attach = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.debug = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.endpoint_template = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.http_retries = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.os_region_name = RegionOne {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851563] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851906] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cinder.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851906] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.851965] nova-scheduler[52185]: DEBUG nova.service [None req-c380d866-0d27-4661-9caa-2b73d8a0c6d4 None None] Creating RPC server for service scheduler {{(pid=52185) start /opt/stack/nova/nova/service.py:182}} [ 460.852154] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.cpu_dedicated_set = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852154] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.cpu_shared_set = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852154] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.image_type_exclude_list = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852154] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852154] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.max_concurrent_disk_ops = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852305] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.max_disk_devices_to_attach = -1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852430] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852961] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852961] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.resource_provider_association_refresh = 300 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.852961] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.shutdown_retry_interval = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.853162] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.853321] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] conductor.workers = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.853509] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] console.allowed_origins = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.853683] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] console.ssl_ciphers = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.853863] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] console.ssl_minimum_version = default {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.853925] nova-scheduler[52181]: DEBUG nova.service [None req-73ec4867-e207-4c63-8be0-7cb321c04716 None None] Creating RPC server for service scheduler {{(pid=52181) start /opt/stack/nova/nova/service.py:182}} [ 460.854050] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] consoleauth.token_ttl = 600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.854286] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.854452] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.854614] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855181] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855181] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855181] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855368] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855413] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855555] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855708] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.855863] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.region_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.856028] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.856195] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.service_type = accelerator {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.856352] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.856504] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.856682] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.857021] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.857079] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.857236] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] cyborg.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.857442] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.backend = sqlalchemy {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.857644] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.connection = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.857815] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.connection_debug = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.858421] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.connection_parameters = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.858421] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.connection_recycle_time = 3600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.858421] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.connection_trace = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.858583] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.db_inc_retry_interval = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.858621] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.db_max_retries = 20 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859028] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.db_max_retry_interval = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859028] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.db_retry_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859102] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.max_overflow = 50 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859252] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.max_pool_size = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859414] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.max_retries = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859767] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.mysql_enable_ndb = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859767] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.859873] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.mysql_wsrep_sync_wait = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.860027] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.pool_timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.860786] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.retry_interval = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.860786] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.slave_connection = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.860786] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.sqlite_synchronous = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.860786] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] database.use_db_reconnect = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861019] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.backend = sqlalchemy {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861097] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.connection = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861262] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.connection_debug = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861426] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.connection_parameters = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861584] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.connection_recycle_time = 3600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861744] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.connection_trace = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.861901] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.db_inc_retry_interval = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.862522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.db_max_retries = 20 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.862522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.db_max_retry_interval = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.862522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.db_retry_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.862522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.max_overflow = 50 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.862758] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.max_pool_size = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.862824] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.max_retries = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863061] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.mysql_enable_ndb = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863132] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863310] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863468] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.pool_timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863627] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.retry_interval = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863778] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.slave_connection = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.863933] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] api_database.sqlite_synchronous = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.864143] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] devices.enabled_mdev_types = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.864324] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.864707] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ephemeral_storage_encryption.enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.864707] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.864894] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.api_servers = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.865092] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.865259] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.865418] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.865592] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.865751] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.865930] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.debug = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.866119] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.default_trusted_certificate_ids = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.866301] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.enable_certificate_validation = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.866788] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.enable_rbd_download = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.866788] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.866912] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.866957] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.867127] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.867284] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.867443] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.num_retries = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.867616] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.rbd_ceph_conf = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.867801] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.rbd_connect_timeout = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.867981] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.rbd_pool = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.868170] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.rbd_user = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.868328] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.region_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.868482] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.868652] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.service_type = image {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.868811] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.868969] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.869175] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.869361] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.869839] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.869839] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.verify_glance_signatures = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.869839] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] glance.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.870029] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] guestfs.debug = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.870230] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.config_drive_cdrom = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.870390] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.config_drive_inject_password = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.870553] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.870711] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.enable_instance_metrics_collection = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.870874] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.enable_remotefx = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.871087] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.instances_path_share = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.871208] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.iscsi_initiator_list = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.871364] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.limit_cpu_features = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.871519] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.871700] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.871861] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.power_state_check_timeframe = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.872036] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.872224] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.872399] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.use_multipath_io = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.872566] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.volume_attach_retry_count = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.872753] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.872939] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.vswitch_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.873113] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.873320] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] mks.enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.873962] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.874174] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] image_cache.manager_interval = 2400 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.874363] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] image_cache.precache_concurrency = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.874743] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] image_cache.remove_unused_base_images = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.874743] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.874840] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.875139] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] image_cache.subdirectory_name = _base {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.875655] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.api_max_retries = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.875826] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.api_retry_interval = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.875986] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.876162] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.auth_type = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.876339] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.876505] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.876715] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.876914] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.877430] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.877430] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.877430] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.877538] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.877697] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878327] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878327] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.partition_key = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878327] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.peer_list = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878446] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.region_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.serial_console_state_timeout = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878671] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.878857] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.service_type = baremetal {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.879023] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.879181] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.879334] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.879506] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.879687] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.879845] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ironic.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.880305] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.880305] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] key_manager.fixed_key = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.880466] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.880640] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.barbican_api_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.880815] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.barbican_endpoint = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.881017] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.barbican_endpoint_type = public {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.881233] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.barbican_region_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.881415] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.881586] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.881750] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.881907] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.882069] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.882253] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.number_of_retries = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.882411] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.retry_delay = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.882587] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.send_service_user_token = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.882640] nova-scheduler[52181]: DEBUG nova.service [None req-73ec4867-e207-4c63-8be0-7cb321c04716 None None] Join ServiceGroup membership for this service scheduler {{(pid=52181) start /opt/stack/nova/nova/service.py:199}} [ 460.882767] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.882864] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-73ec4867-e207-4c63-8be0-7cb321c04716 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=52181) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 460.882927] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.883081] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.verify_ssl = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.883232] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican.verify_ssl_path = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.883391] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.883571] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.auth_type = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.883726] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.883879] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.884046] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.884236] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.884393] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.884555] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.884737] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] barbican_service_user.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.884931] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.approle_role_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.885098] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.approle_secret_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.885262] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.885435] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.885699] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.885737] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886036] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886070] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.kv_mountpoint = secret {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886236] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.kv_version = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886394] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.namespace = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886547] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.root_token_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886726] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.886888] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.ssl_ca_crt_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.887058] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.887243] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.use_ssl = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.887436] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.887630] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.887786] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.887948] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.888453] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.888453] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.888453] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.888580] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.888693] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.888886] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889057] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889213] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.region_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889362] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889524] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.service_type = identity {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889677] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889830] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.889983] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.890166] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.890365] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.890523] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] keystone.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.890603] nova-scheduler[52185]: DEBUG nova.service [None req-c380d866-0d27-4661-9caa-2b73d8a0c6d4 None None] Join ServiceGroup membership for this service scheduler {{(pid=52185) start /opt/stack/nova/nova/service.py:199}} [ 460.890753] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.connection_uri = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.890938] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_mode = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.890976] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-c380d866-0d27-4661-9caa-2b73d8a0c6d4 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=52185) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 460.891115] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_model_extra_flags = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.891283] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_models = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.891445] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_power_governor_high = performance {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.891628] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_power_governor_low = powersave {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.891784] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_power_management = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.891972] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.892296] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.device_detach_attempts = 8 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.892346] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.device_detach_timeout = 20 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.892479] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.disk_cachemodes = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.892632] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.disk_prefix = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.892877] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.enabled_perf_events = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.892941] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.file_backed_memory = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.893258] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.gid_maps = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.893330] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.hw_disk_discard = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.893492] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.hw_machine_type = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.893659] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_rbd_ceph_conf = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.893864] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.894168] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.894332] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_rbd_glance_store_name = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.894502] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_rbd_pool = rbd {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.894673] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_type = default {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.894830] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.images_volume_group = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895024] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.inject_key = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895185] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.inject_partition = -2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895340] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.inject_password = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895494] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.iscsi_iface = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895645] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.iser_use_multipath = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895796] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_bandwidth = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.895949] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.896121] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_downtime = 500 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.896309] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.896472] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.896660] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_inbound_addr = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.897304] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.897304] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_permit_post_copy = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.897304] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_scheme = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.897455] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_timeout_action = abort {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.897486] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_tunnelled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.897651] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_uri = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898066] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.live_migration_with_native_tls = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898066] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.max_queues = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898185] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898280] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.nfs_mount_options = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898522] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898680] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.898838] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.num_iser_scan_tries = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.899011] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.num_memory_encrypted_guests = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.899192] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.899349] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.num_pcie_ports = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.899509] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.num_volume_scan_tries = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.899923] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.pmem_namespaces = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.899923] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.quobyte_client_cfg = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.900068] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.900225] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rbd_connect_timeout = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.900388] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901059] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901059] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rbd_secret_uuid = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901059] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rbd_user = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901226] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901272] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.remote_filesystem_transport = ssh {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rescue_image_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901560] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rescue_kernel_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901711] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rescue_ramdisk_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.901874] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.902052] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.rx_queue_size = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.902236] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.smbfs_mount_options = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.902460] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.902622] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.snapshot_compression = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.902774] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.snapshot_image_format = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.902984] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.903163] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.sparse_logical_volumes = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.903818] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.swtpm_enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.903818] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.swtpm_group = tss {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.903818] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.swtpm_user = tss {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.903818] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.sysinfo_serial = unique {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904049] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.tx_queue_size = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904146] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.uid_maps = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904307] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.use_virtio_for_bridges = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904474] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.virt_type = kvm {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904668] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.volume_clear = zero {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904833] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.volume_clear_size = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.904995] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.volume_use_multipath = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.905453] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_cache_path = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.905453] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.905568] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_mount_group = qemu {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.905674] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_mount_opts = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.905838] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.906508] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.906508] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.vzstorage_mount_user = stack {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.906508] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.906713] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.906713] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.auth_type = password {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.906864] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907285] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907285] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907394] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907496] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907682] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.default_floating_pool = public {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907838] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.907993] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.extension_sync_interval = 600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.908186] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.http_retries = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.908351] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.908502] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.908661] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909120] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909120] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909249] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.ovs_bridge = br-int {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909340] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.physnets = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909955] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.region_name = RegionOne {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909955] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.service_metadata_proxy = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909955] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.909955] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.service_type = network {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.910186] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.910268] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.910424] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.910576] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.910750] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.910910] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] neutron.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.911085] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] notifications.bdms_in_notifications = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.911290] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] notifications.default_level = INFO {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.911468] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] notifications.notification_format = unversioned {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.911625] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] notifications.notify_on_state_change = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.911795] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.911971] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] pci.alias = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.912148] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] pci.device_spec = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.912579] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] pci.report_in_placement = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.912579] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.912683] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.auth_type = password {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.912829] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.auth_url = http://10.180.1.21/identity {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913030] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913191] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913352] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913501] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913659] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913817] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.default_domain_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.913968] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.default_domain_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.914142] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.domain_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.914314] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.domain_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.914495] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.914654] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.914806] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.914957] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.915119] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.915284] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.password = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.915434] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.project_domain_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.915590] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.project_domain_name = Default {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.915751] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.project_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.915918] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.project_name = service {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.916089] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.region_name = RegionOne {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.916246] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.916406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.service_type = placement {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.916561] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.916735] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.916898] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.917061] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.system_scope = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.917336] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.917413] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.trust_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.917565] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.user_domain_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.917911] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.user_domain_name = Default {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.917911] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.user_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.918044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.username = placement {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.918226] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.918380] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] placement.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.918552] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.cores = 20 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.918742] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.count_usage_from_placement = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.918908] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.919086] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.injected_file_content_bytes = 10240 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.919250] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.injected_file_path_length = 255 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.919406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.injected_files = 5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.919840] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.instances = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.919840] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.key_pairs = 100 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.919921] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.metadata_items = 128 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.920024] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.ram = 51200 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.920207] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.recheck_quota = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.920381] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.server_group_members = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.920546] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] quota.server_groups = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.920722] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rdp.enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.921062] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.921295] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.921485] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.921669] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.image_metadata_prefilter = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.921835] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.922024] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.max_attempts = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.922182] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.max_placement_results = 1000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.922619] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.922619] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.query_placement_for_availability_zone = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.922740] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.query_placement_for_image_type_support = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.922823] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.923050] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] scheduler.workers = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.923275] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.923455] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.923663] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.923856] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.924029] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.924191] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.924369] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.924594] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.924849] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.host_subset_size = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.925088] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.925315] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.925517] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.isolated_hosts = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.925725] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.isolated_images = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.925966] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.926231] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.926411] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.pci_in_placement = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.926643] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.926877] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.927148] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.927315] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.927478] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.927640] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.927798] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.track_instance_changes = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.928162] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.928162] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metrics.required = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.928314] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metrics.weight_multiplier = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.928551] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.928618] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] metrics.weight_setting = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.928965] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.929185] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] serial_console.enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.929396] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] serial_console.port_range = 10000:20000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.929566] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.929744] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.929908] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] serial_console.serialproxy_port = 6083 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.930133] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.930305] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.auth_type = password {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.930465] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.930624] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931416] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931416] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931416] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931416] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.send_service_user_token = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931416] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931695] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] service_user.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.931751] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.agent_enabled = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.932053] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.932448] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.932655] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.932826] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.html5proxy_port = 6082 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.932985] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.image_compression = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.933174] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.jpeg_compression = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.933329] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.playback_compression = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.933496] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.server_listen = 127.0.0.1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.933708] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.933869] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.streaming_mode = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.934036] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] spice.zlib_compression = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.934222] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] upgrade_levels.baseapi = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.934376] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] upgrade_levels.cert = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.934542] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] upgrade_levels.compute = auto {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.934731] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] upgrade_levels.conductor = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.934884] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] upgrade_levels.scheduler = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.935063] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.935298] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.auth_type = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.935548] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.935788] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.936215] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.936332] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.936602] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.936858] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.937143] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vendordata_dynamic_auth.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.937488] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.api_retry_count = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.937750] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.ca_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.937955] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.cache_prefix = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.938132] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.cluster_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.938334] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.connection_pool_size = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.938482] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.console_delay_seconds = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.938640] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.datastore_regex = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.938795] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.host_ip = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.938946] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.host_password = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.939130] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.host_port = 443 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.939279] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.host_username = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.939431] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.939587] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.integration_bridge = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.939740] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.maximum_objects = 100 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.939895] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.pbm_default_policy = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.940071] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.pbm_enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.940224] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.pbm_wsdl_location = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.940386] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.940537] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.serial_port_proxy_uri = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.940686] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.serial_port_service_uri = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.940851] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.task_poll_interval = 0.5 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.941027] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.use_linked_clone = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.941189] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.vnc_keymap = en-us {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.941348] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.vnc_port = 5900 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.941814] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vmware.vnc_port_total = 10000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.941814] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.auth_schemes = ['none'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.941934] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.enabled = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.942194] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.942381] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.943232] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.novncproxy_port = 6080 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.943232] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.server_listen = 127.0.0.1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.943232] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.943232] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.vencrypt_ca_certs = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.943232] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.vencrypt_client_cert = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] vnc.vencrypt_client_key = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944280] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.disable_rootwrap = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944328] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.enable_numa_live_migration = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944474] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944651] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944790] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.944945] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.libvirt_disable_apic = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.945116] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.945273] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.945434] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.945580] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.945732] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.945888] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.946052] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.946234] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.946377] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.946535] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.946742] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.946912] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.client_socket_timeout = 900 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.947083] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.default_pool_size = 1000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.947244] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.keep_alive = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.947437] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.max_header_line = 16384 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.947604] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.secure_proxy_ssl_header = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.947767] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.ssl_ca_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.947929] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.ssl_cert_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.948095] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.ssl_key_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.948257] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.tcp_keepidle = 600 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.948430] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.948589] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] zvm.ca_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.948744] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] zvm.cloud_connector_url = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.948990] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.949180] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] zvm.reachable_timeout = 300 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.949376] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.949537] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.949701] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.949887] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.950073] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.950880] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.enforce_new_defaults = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.950880] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.enforce_scope = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.950880] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.policy_default_rule = default {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.950880] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951129] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.policy_file = policy.yaml {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951175] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951340] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951494] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951645] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951798] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.951990] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.952199] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.952406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.connection_string = messaging:// {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.952569] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.enabled = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.952751] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.es_doc_type = notification {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.952929] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.es_scroll_size = 10000 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.953104] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.es_scroll_time = 2m {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.953262] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.filter_error_trace = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.953421] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.hmac_keys = SECRET_KEY {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.953579] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.sentinel_service_name = mymaster {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.953739] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.socket_timeout = 0.1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.953894] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] profiler.trace_sqlalchemy = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.954071] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] remote_debug.host = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.954226] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] remote_debug.port = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.954408] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.954586] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.954762] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.954922] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.955149] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.955251] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.955409] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.955574] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.955714] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.955865] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.956046] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.956209] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.956380] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.956537] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.956714] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.956900] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.957073] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.957230] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.957390] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.957551] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.957709] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.957880] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.958044] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.958205] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.958367] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.958537] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.ssl = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959406] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_rabbit.ssl_version = {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959566] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959728] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_notifications.retry = -1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.959936] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.960118] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_messaging_notifications.transport_url = **** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.960316] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.auth_section = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.960474] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.auth_type = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.960627] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.cafile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.960777] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.certfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.960933] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.collect_timing = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961301] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.connect_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961301] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.connect_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961415] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.endpoint_id = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961540] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.endpoint_override = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961691] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.insecure = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961840] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.keyfile = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.961988] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.max_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.962175] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.min_version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.962339] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.region_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.962510] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.service_name = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.962660] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.service_type = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.962813] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.split_loggers = False {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.962959] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.status_code_retries = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.963122] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.status_code_retry_delay = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.963272] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.timeout = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.963420] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.valid_interfaces = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.963566] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_limit.version = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.963759] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_reports.file_event_handler = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.963916] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.964077] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] oslo_reports.log_dir = None {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 460.964208] nova-scheduler[51137]: DEBUG oslo_service.service [None req-0823f57e-00fc-470d-8fc4-c36eba2f0050 None None] ******************************************************************************** {{(pid=51137) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 591.834699] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Starting to schedule for instances: ['f1894e2a-156c-420c-91af-a4eedaafb017'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 591.839149] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 591.843019] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 591.843019] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 591.843019] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 591.843019] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 592.279207] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.280113] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.281599] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.287753] nova-scheduler[52181]: DEBUG oslo_db.sqlalchemy.engines [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52181) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 592.305504] nova-scheduler[52181]: DEBUG oslo_db.sqlalchemy.engines [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Parent process 51137 forked (52181) with an open database connection, which is being discarded and recreated. {{(pid=52181) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 592.315088] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.315088] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.316484] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.322993] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.323657] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.324459] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:02:28Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 592.324996] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 592.325191] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 592.325349] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 592.325518] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 592.326108] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 592.326835] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.327505] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.327505] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.327637] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.327772] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.328022] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.328141] nova-scheduler[52181]: DEBUG nova.filters [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 592.328488] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 592.328602] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 592.329123] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Attempting to claim resources in the placement API for instance f1894e2a-156c-420c-91af-a4eedaafb017 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 592.423905] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] [instance: f1894e2a-156c-420c-91af-a4eedaafb017] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 592.424270] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 592.424478] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 592.424765] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d2ce4208-2032-4f1b-8d6a-890bf3f1fa09 tempest-ServerDiagnosticsTest-844409055 tempest-ServerDiagnosticsTest-844409055-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.121300] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Starting to schedule for instances: ['c731bc6a-9b0d-4e3a-b5ca-009d79896d27'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 593.121300] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 593.121300] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.122552] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.122750] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.122995] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 593.195287] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.195287] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.196503] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.205392] nova-scheduler[52185]: DEBUG oslo_db.sqlalchemy.engines [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52185) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 593.230390] nova-scheduler[52185]: DEBUG oslo_db.sqlalchemy.engines [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Parent process 51137 forked (52185) with an open database connection, which is being discarded and recreated. {{(pid=52185) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 593.247667] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.247667] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.248399] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.254631] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.255047] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.256553] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='0',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_62b2e3dba50f46108124ecd6f560df03='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:07Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=1) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 593.257286] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 593.257582] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 593.258074] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Update host state with instances: ['f1894e2a-156c-420c-91af-a4eedaafb017'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 593.258367] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.258954] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 593.259476] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.259827] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.260230] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.260563] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.261578] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.261578] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.261578] nova-scheduler[52185]: DEBUG nova.filters [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.261578] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 593.261874] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 593.262252] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Attempting to claim resources in the placement API for instance c731bc6a-9b0d-4e3a-b5ca-009d79896d27 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 593.334955] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] [instance: c731bc6a-9b0d-4e3a-b5ca-009d79896d27] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 593.335329] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.336060] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.336880] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6263ba31-4ac7-4ed2-9e75-ff30010bd9d2 tempest-ServersAdminNegativeTestJSON-2079946617 tempest-ServersAdminNegativeTestJSON-2079946617-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.767588] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Starting to schedule for instances: ['09e936da-040a-438a-a320-28616de7bb75'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 593.767588] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 593.767588] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.767588] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.767588] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.767900] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 593.833225] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.833452] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.833620] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.843086] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.843086] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.843086] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.846183] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.846183] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.846353] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='0',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_62b2e3dba50f46108124ecd6f560df03='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:07Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=1) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 593.846353] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 593.846450] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 593.848533] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state with instances: ['f1894e2a-156c-420c-91af-a4eedaafb017', 'c731bc6a-9b0d-4e3a-b5ca-009d79896d27'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 593.848533] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.848533] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 593.848533] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.848533] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.848878] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.848878] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.848941] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.850049] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.850049] nova-scheduler[52181]: DEBUG nova.filters [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.850049] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 593.850276] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 593.850526] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Attempting to claim resources in the placement API for instance 09e936da-040a-438a-a320-28616de7bb75 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 593.951033] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] [instance: 09e936da-040a-438a-a320-28616de7bb75] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 593.951352] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.951555] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.951797] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-797add29-9b3a-43bc-9bf6-f89dc30b11cd tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.822986] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Starting to schedule for instances: ['3681b35b-c962-4e80-8f9c-df0db2f515e9'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 595.823454] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 595.823621] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.823963] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.827146] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.827276] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 595.889175] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Starting to schedule for instances: ['dbb50c25-381f-4878-945b-170f2681f2ae'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 595.889371] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.889371] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.889523] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 595.889558] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.889589] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.889695] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.889903] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.890102] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 595.904112] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.904357] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.904518] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.909027] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.909294] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.909668] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_62b2e3dba50f46108124ecd6f560df03='1',num_proj_73f02488e0f04572afd9b672c2b5cf0f='1',num_proj_859a3caa90ab40879a27f7eb2ba8908b='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:09Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=3) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 595.909969] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 595.910149] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 595.910363] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Update host state with instances: ['f1894e2a-156c-420c-91af-a4eedaafb017', 'c731bc6a-9b0d-4e3a-b5ca-009d79896d27', '09e936da-040a-438a-a320-28616de7bb75'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 595.910472] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.911481] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 595.911481] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.911481] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.911481] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.911481] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.912146] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.912146] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.912146] nova-scheduler[52185]: DEBUG nova.filters [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.914414] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 595.914597] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 595.914787] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Attempting to claim resources in the placement API for instance 3681b35b-c962-4e80-8f9c-df0db2f515e9 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 595.956546] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.957062] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.957304] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.974381] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.974854] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.975150] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.981488] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.981711] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.982136] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_62b2e3dba50f46108124ecd6f560df03='1',num_proj_73f02488e0f04572afd9b672c2b5cf0f='1',num_proj_859a3caa90ab40879a27f7eb2ba8908b='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:09Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=3) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 595.982444] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 595.982613] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 595.982765] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state with instances: ['f1894e2a-156c-420c-91af-a4eedaafb017', 'c731bc6a-9b0d-4e3a-b5ca-009d79896d27', '09e936da-040a-438a-a320-28616de7bb75'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 595.982926] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.983249] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 595.983473] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.983649] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.983842] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.984013] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.984354] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.984551] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.984722] nova-scheduler[52181]: DEBUG nova.filters [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.984975] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 595.985204] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 595.985651] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Attempting to claim resources in the placement API for instance dbb50c25-381f-4878-945b-170f2681f2ae {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 596.008016] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] [instance: 3681b35b-c962-4e80-8f9c-df0db2f515e9] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 596.008016] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 596.008016] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 596.008341] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f5c1b416-d9aa-42f4-ad1c-7382d98aa4e0 tempest-TenantUsagesTestJSON-2036990172 tempest-TenantUsagesTestJSON-2036990172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 596.064099] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] [instance: dbb50c25-381f-4878-945b-170f2681f2ae] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 596.064329] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 596.066402] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 596.066402] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-733d259c-18d3-48c3-94b3-b8409db5e48a tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.907972] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting to schedule for instances: ['4dbfaeea-229a-4ed1-afb2-bd8e167a1385'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 597.908541] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 597.909534] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 597.909677] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 597.911311] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 597.911311] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 597.969895] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.970149] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.970733] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.981533] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.981533] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.981533] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.985498] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.985498] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.985840] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='0',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_62b2e3dba50f46108124ecd6f560df03='1',num_proj_73f02488e0f04572afd9b672c2b5cf0f='1',num_proj_859a3caa90ab40879a27f7eb2ba8908b='1',num_proj_bd26fa229f324ee7aca2569d83ed0032='1',num_proj_fc4180d54c1c427081e8004cc159478f='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:11Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=5) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 597.986511] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 597.986511] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 597.986511] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with instances: ['f1894e2a-156c-420c-91af-a4eedaafb017', 'c731bc6a-9b0d-4e3a-b5ca-009d79896d27', '09e936da-040a-438a-a320-28616de7bb75', '3681b35b-c962-4e80-8f9c-df0db2f515e9', 'dbb50c25-381f-4878-945b-170f2681f2ae'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 597.986728] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.987094] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 597.987173] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.988052] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.988052] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.988052] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.988052] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.989987] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.989987] nova-scheduler[52185]: DEBUG nova.filters [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.990217] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 597.991797] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 597.991989] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Attempting to claim resources in the placement API for instance 4dbfaeea-229a-4ed1-afb2-bd8e167a1385 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 598.083542] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] [instance: 4dbfaeea-229a-4ed1-afb2-bd8e167a1385] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 598.084026] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 598.084127] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 598.084260] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-97f64e23-a856-4e36-b538-6171155631ac tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.596497] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Starting to schedule for instances: ['93b26227-ad64-4343-aed9-ba6622aaf83e'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 600.596789] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 600.596953] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.601123] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.601123] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.601123] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 600.648750] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.648980] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.649161] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.657259] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.658544] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.658544] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.660289] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.660518] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.661136] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='0',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_33983ea7f05b435da567e01fa0715162='1',num_proj_62b2e3dba50f46108124ecd6f560df03='1',num_proj_73f02488e0f04572afd9b672c2b5cf0f='1',num_proj_859a3caa90ab40879a27f7eb2ba8908b='1',num_proj_bd26fa229f324ee7aca2569d83ed0032='1',num_proj_fc4180d54c1c427081e8004cc159478f='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:13Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=6) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 600.662099] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-15T19:03:10Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-340597183',updated_at=None,uuid=1d372180-ad79-4e91-a873-ab0b2d9d8749)] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 600.662099] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 600.662347] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Update host state with instances: ['f1894e2a-156c-420c-91af-a4eedaafb017', 'c731bc6a-9b0d-4e3a-b5ca-009d79896d27', '09e936da-040a-438a-a320-28616de7bb75', '3681b35b-c962-4e80-8f9c-df0db2f515e9', 'dbb50c25-381f-4878-945b-170f2681f2ae', '4dbfaeea-229a-4ed1-afb2-bd8e167a1385'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 600.662347] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.662347] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 600.662347] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.662677] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.662677] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.662894] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.663038] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.663208] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.663381] nova-scheduler[52181]: DEBUG nova.filters [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.663592] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 600.663753] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 600.663922] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Attempting to claim resources in the placement API for instance 93b26227-ad64-4343-aed9-ba6622aaf83e {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 600.721440] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] [instance: 93b26227-ad64-4343-aed9-ba6622aaf83e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 600.721780] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.721997] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.722216] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-b2a35850-14c6-4f74-8a9b-fc0caf713225 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501 tempest-FloatingIPsAssociationNegativeTestJSON-1043172501-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.380417] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Starting to schedule for instances: ['4460c09b-b99a-4786-99e5-01b88b7157c4'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 616.380417] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 616.380417] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.380417] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.380922] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.380922] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 616.436442] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.436683] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.436864] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.447313] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.447527] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.447684] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.450738] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.450942] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.452068] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 616.452068] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 616.453495] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 616.453495] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 616.453495] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.453878] nova-scheduler[52185]: DEBUG nova.filters [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 616.453878] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 62.314442 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 616.453878] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 616.453878] nova-scheduler[52185]: INFO nova.filters [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filter ComputeFilter returned 0 hosts [ 616.453878] nova-scheduler[52185]: DEBUG nova.filters [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filtering removed all hosts for the request with instance ID '4460c09b-b99a-4786-99e5-01b88b7157c4'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 616.455815] nova-scheduler[52185]: INFO nova.filters [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filtering removed all hosts for the request with instance ID '4460c09b-b99a-4786-99e5-01b88b7157c4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 616.455815] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 616.455815] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9a7ddac2-405b-4ab4-80f1-02f586d1d26a tempest-DeleteServersAdminTestJSON-306082810 tempest-DeleteServersAdminTestJSON-306082810-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 617.937147] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Starting to schedule for instances: ['381974bf-c879-46e5-8d96-495a9b9eb982'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 617.937471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 617.937636] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 617.937811] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 617.938024] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 617.938209] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 617.984875] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.985117] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.985313] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.995226] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.995445] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.995608] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.998236] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.998376] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.998769] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 617.999076] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 617.999267] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 617.999515] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 618.003020] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.003020] nova-scheduler[52181]: DEBUG nova.filters [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 618.003020] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 63.861897 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 618.003020] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 618.003020] nova-scheduler[52181]: INFO nova.filters [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Filter ComputeFilter returned 0 hosts [ 618.003532] nova-scheduler[52181]: DEBUG nova.filters [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Filtering removed all hosts for the request with instance ID '381974bf-c879-46e5-8d96-495a9b9eb982'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 618.003532] nova-scheduler[52181]: INFO nova.filters [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Filtering removed all hosts for the request with instance ID '381974bf-c879-46e5-8d96-495a9b9eb982'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 618.003532] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 618.003532] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-09cfe728-e16e-44b9-8f3e-e56882817815 tempest-ServersAdmin275Test-1865677316 tempest-ServersAdmin275Test-1865677316-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 618.970997] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Starting to schedule for instances: ['bf3febf6-cd6b-4c50-85b1-537b541a7d62'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 618.971319] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 618.971477] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.971654] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.972035] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.972785] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 619.025149] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.025386] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.025563] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.035144] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.035407] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.035582] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.037930] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.038225] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.038611] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 619.038888] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 619.039707] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 619.039707] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 619.039707] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.039920] nova-scheduler[52185]: DEBUG nova.filters [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 619.039920] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 64.901584 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 619.040086] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 619.040238] nova-scheduler[52185]: INFO nova.filters [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Filter ComputeFilter returned 0 hosts [ 619.040391] nova-scheduler[52185]: DEBUG nova.filters [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Filtering removed all hosts for the request with instance ID 'bf3febf6-cd6b-4c50-85b1-537b541a7d62'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 619.040529] nova-scheduler[52185]: INFO nova.filters [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Filtering removed all hosts for the request with instance ID 'bf3febf6-cd6b-4c50-85b1-537b541a7d62'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 619.040678] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 619.040823] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-efa863cf-3e03-4569-8f37-c34e8e3ffdf1 tempest-ServerDiagnosticsNegativeTest-578356840 tempest-ServerDiagnosticsNegativeTest-578356840-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 619.602236] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Starting to schedule for instances: ['0f5806b0-1b69-404b-861f-cd98d05639f2'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 619.602236] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 619.602236] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.602236] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.602236] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.602894] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 619.652097] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.652491] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.652838] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.659852] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.660209] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.660512] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.663024] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.663358] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.663873] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 619.664315] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 619.664606] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 619.667187] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 619.667187] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.667187] nova-scheduler[52181]: DEBUG nova.filters [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 619.667187] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 65.527339 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 619.667341] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 619.667341] nova-scheduler[52181]: INFO nova.filters [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filter ComputeFilter returned 0 hosts [ 619.667341] nova-scheduler[52181]: DEBUG nova.filters [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filtering removed all hosts for the request with instance ID '0f5806b0-1b69-404b-861f-cd98d05639f2'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 619.667341] nova-scheduler[52181]: INFO nova.filters [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filtering removed all hosts for the request with instance ID '0f5806b0-1b69-404b-861f-cd98d05639f2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 619.667341] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 619.667491] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-06cb6bb5-7e21-4985-b6da-c5656b3ba35e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 620.596046] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Starting to schedule for instances: ['6ee76f18-9840-4d27-bb7c-94571dc7d651'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 620.597492] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 620.597791] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.598096] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.598507] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.598845] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 620.666808] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.666808] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.666808] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.679937] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.680175] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.680337] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.682856] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.683065] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.683436] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 620.683729] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 620.683897] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 620.684071] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 620.684238] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.684505] nova-scheduler[52185]: DEBUG nova.filters [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 620.685201] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 66.546465 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 620.685201] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 620.685201] nova-scheduler[52185]: INFO nova.filters [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Filter ComputeFilter returned 0 hosts [ 620.685201] nova-scheduler[52185]: DEBUG nova.filters [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Filtering removed all hosts for the request with instance ID '6ee76f18-9840-4d27-bb7c-94571dc7d651'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 620.685377] nova-scheduler[52185]: INFO nova.filters [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Filtering removed all hosts for the request with instance ID '6ee76f18-9840-4d27-bb7c-94571dc7d651'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 620.685432] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 620.685576] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-44702fa8-6484-4dbd-b384-0bec581caf2a tempest-ServersWithSpecificFlavorTestJSON-430937670 tempest-ServersWithSpecificFlavorTestJSON-430937670-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 621.116091] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Starting to schedule for instances: ['86c1eb22-5da1-4d79-8db6-b131e0a0d1c3'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 621.116399] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 621.116558] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.116785] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.116987] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.117305] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 621.174636] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.174759] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.175336] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.186145] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.186375] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.186537] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.193296] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.194190] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.194190] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 621.194372] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 621.194479] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 621.194936] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 621.194936] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.195124] nova-scheduler[52181]: DEBUG nova.filters [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 621.195332] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 67.056973 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 621.195370] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 621.195517] nova-scheduler[52181]: INFO nova.filters [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Filter ComputeFilter returned 0 hosts [ 621.195665] nova-scheduler[52181]: DEBUG nova.filters [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Filtering removed all hosts for the request with instance ID '86c1eb22-5da1-4d79-8db6-b131e0a0d1c3'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 621.195806] nova-scheduler[52181]: INFO nova.filters [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Filtering removed all hosts for the request with instance ID '86c1eb22-5da1-4d79-8db6-b131e0a0d1c3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 621.195948] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 621.197546] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d68d1347-88bd-4d90-9505-4b36b46d1fc8 tempest-ImagesNegativeTestJSON-295564784 tempest-ImagesNegativeTestJSON-295564784-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 624.075769] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Starting to schedule for instances: ['6ba8cf5b-f60b-462b-a955-eaeba2849c0d'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 624.076073] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 624.076243] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.076686] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.076686] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.076976] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 624.136368] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.136368] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.136368] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.143512] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.143922] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.144175] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.147026] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.147299] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.147925] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 624.148304] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 624.148304] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 624.148504] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 624.148722] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.149149] nova-scheduler[52185]: DEBUG nova.filters [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 624.149429] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 70.011151 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 624.149649] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 624.149944] nova-scheduler[52185]: INFO nova.filters [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Filter ComputeFilter returned 0 hosts [ 624.150203] nova-scheduler[52185]: DEBUG nova.filters [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Filtering removed all hosts for the request with instance ID '6ba8cf5b-f60b-462b-a955-eaeba2849c0d'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 624.153856] nova-scheduler[52185]: INFO nova.filters [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Filtering removed all hosts for the request with instance ID '6ba8cf5b-f60b-462b-a955-eaeba2849c0d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 624.153856] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 624.153856] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-556dd900-feb1-4925-8ffd-74662c06ddbc tempest-ServersTestFqdnHostnames-46354780 tempest-ServersTestFqdnHostnames-46354780-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 625.031162] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Starting to schedule for instances: ['0f32ff9f-758b-4616-9291-f141b74acdf7'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 625.031162] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 625.031162] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.031162] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.031513] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.031513] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 625.091394] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.091868] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.092476] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.101935] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.102182] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.102344] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.109192] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.109405] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.109833] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 625.110154] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 625.110331] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 625.111619] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 625.111843] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.113197] nova-scheduler[52181]: DEBUG nova.filters [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 625.113434] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 70.975163 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 625.113707] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 625.113773] nova-scheduler[52181]: INFO nova.filters [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Filter ComputeFilter returned 0 hosts [ 625.113931] nova-scheduler[52181]: DEBUG nova.filters [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Filtering removed all hosts for the request with instance ID '0f32ff9f-758b-4616-9291-f141b74acdf7'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 625.114095] nova-scheduler[52181]: INFO nova.filters [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Filtering removed all hosts for the request with instance ID '0f32ff9f-758b-4616-9291-f141b74acdf7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 625.114232] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 625.114376] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4774e3e4-1696-4a30-b5df-b0f9fef76e4f tempest-VolumesAssistedSnapshotsTest-1513480278 tempest-VolumesAssistedSnapshotsTest-1513480278-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 626.371095] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting to schedule for instances: ['d80cb5ce-2aaa-478d-85fa-23eabb8c9ad8'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 626.371427] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 626.371987] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 626.371987] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 626.371987] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 626.372165] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 626.440177] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.440177] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.440177] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.451578] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.453174] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.453174] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.454428] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.454613] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.454979] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 626.455729] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 626.455729] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 626.455729] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 626.455997] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.456184] nova-scheduler[52185]: DEBUG nova.filters [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 626.456407] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 72.318145 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 626.456608] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 626.456763] nova-scheduler[52185]: INFO nova.filters [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ComputeFilter returned 0 hosts [ 626.456858] nova-scheduler[52185]: DEBUG nova.filters [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtering removed all hosts for the request with instance ID 'd80cb5ce-2aaa-478d-85fa-23eabb8c9ad8'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 626.456988] nova-scheduler[52185]: INFO nova.filters [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtering removed all hosts for the request with instance ID 'd80cb5ce-2aaa-478d-85fa-23eabb8c9ad8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 626.457155] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 626.457339] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-63528711-7e54-445e-8353-14eab703533e tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 627.173196] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Starting to schedule for instances: ['a514e44b-9214-4a83-aba0-4af32e95c94c'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.173196] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.173526] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.174901] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.174901] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.175342] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.232283] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.232508] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.232680] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.243105] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.243341] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.243568] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.249990] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.250208] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.250580] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.250861] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.251042] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.251221] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.251388] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.251653] nova-scheduler[52181]: DEBUG nova.filters [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.251868] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 73.11361 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 627.252032] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 627.252184] nova-scheduler[52181]: INFO nova.filters [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Filter ComputeFilter returned 0 hosts [ 627.252331] nova-scheduler[52181]: DEBUG nova.filters [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Filtering removed all hosts for the request with instance ID 'a514e44b-9214-4a83-aba0-4af32e95c94c'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 627.252467] nova-scheduler[52181]: INFO nova.filters [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Filtering removed all hosts for the request with instance ID 'a514e44b-9214-4a83-aba0-4af32e95c94c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 627.252610] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.252753] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-68056aff-2fee-47c8-8ef4-2644a4005bb6 tempest-ServerExternalEventsTest-624411406 tempest-ServerExternalEventsTest-624411406-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 628.911828] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Starting to schedule for instances: ['7b3fab69-c129-4abe-aa5a-1f873260df19'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 628.912142] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 628.912291] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 628.912480] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 628.912659] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 628.912840] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 628.965163] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.965163] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.965324] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.983349] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.983958] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.983958] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.987941] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.987941] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.988363] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 628.988363] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 628.988578] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 628.988578] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 628.988578] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.988713] nova-scheduler[52185]: DEBUG nova.filters [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 628.988713] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 74.84972 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 628.988713] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 628.988713] nova-scheduler[52185]: INFO nova.filters [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Filter ComputeFilter returned 0 hosts [ 628.988713] nova-scheduler[52185]: DEBUG nova.filters [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Filtering removed all hosts for the request with instance ID '7b3fab69-c129-4abe-aa5a-1f873260df19'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 628.988900] nova-scheduler[52185]: INFO nova.filters [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Filtering removed all hosts for the request with instance ID '7b3fab69-c129-4abe-aa5a-1f873260df19'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 628.988900] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 628.988900] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-cb8594b1-2984-48bb-b2a1-c1d0972a89d4 tempest-FloatingIPsAssociationTestJSON-1610426689 tempest-FloatingIPsAssociationTestJSON-1610426689-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 636.503016] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Starting to schedule for instances: ['eeae9a99-e184-49ea-880f-0a429d893129'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 636.503371] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 636.503471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 636.503644] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 636.504321] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 636.504321] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 636.559089] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.559272] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.559457] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.569739] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.570173] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.570173] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.573293] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 636.573293] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 636.573383] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 636.573459] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 636.573662] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 636.573790] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 636.573873] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 636.574150] nova-scheduler[52181]: DEBUG nova.filters [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 636.574354] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 82.436108 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 636.574506] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 636.574656] nova-scheduler[52181]: INFO nova.filters [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Filter ComputeFilter returned 0 hosts [ 636.574801] nova-scheduler[52181]: DEBUG nova.filters [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Filtering removed all hosts for the request with instance ID 'eeae9a99-e184-49ea-880f-0a429d893129'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 636.574935] nova-scheduler[52181]: INFO nova.filters [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Filtering removed all hosts for the request with instance ID 'eeae9a99-e184-49ea-880f-0a429d893129'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 636.575091] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 636.575237] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d3f4ff63-8cf9-487f-a6a2-aa835e14a684 tempest-ServerActionsTestOtherB-626557989 tempest-ServerActionsTestOtherB-626557989-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 637.394670] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Starting to schedule for instances: ['98b02f09-e666-421c-9a7f-baa6aa8ed7f7'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 637.394958] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 637.395774] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.396148] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.396280] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.396424] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 637.446184] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.446417] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.446584] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.455662] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.455867] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.456065] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.460518] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.460738] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.461125] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 637.461429] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 637.461598] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 637.461753] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 637.461914] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.462192] nova-scheduler[52185]: DEBUG nova.filters [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 637.462422] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 83.324153 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 637.462598] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 637.462761] nova-scheduler[52185]: INFO nova.filters [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filter ComputeFilter returned 0 hosts [ 637.462908] nova-scheduler[52185]: DEBUG nova.filters [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filtering removed all hosts for the request with instance ID '98b02f09-e666-421c-9a7f-baa6aa8ed7f7'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 637.463057] nova-scheduler[52185]: INFO nova.filters [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filtering removed all hosts for the request with instance ID '98b02f09-e666-421c-9a7f-baa6aa8ed7f7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 637.463206] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 637.463348] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-75b5674a-8bca-4684-a236-8e3edee29fae tempest-MigrationsAdminTest-1656569401 tempest-MigrationsAdminTest-1656569401-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 637.687008] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Starting to schedule for instances: ['b7b62f1a-ec58-4f3f-9551-2643486c9a06', '9c20f3ba-9b92-40cf-892e-676947d47277', '8a43915f-0fb8-4bca-ac72-30d4799c4598'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 637.687419] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 637.687647] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.687899] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.688164] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.688401] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 637.729380] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.729618] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.729795] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.737915] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.738170] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.738344] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.740451] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.740657] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.741083] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 637.741327] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 637.741501] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 637.741658] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 637.741823] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.742100] nova-scheduler[52181]: DEBUG nova.filters [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 637.742390] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 83.604061 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 637.742496] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 637.742660] nova-scheduler[52181]: INFO nova.filters [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Filter ComputeFilter returned 0 hosts [ 637.742812] nova-scheduler[52181]: DEBUG nova.filters [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Filtering removed all hosts for the request with instance ID 'b7b62f1a-ec58-4f3f-9551-2643486c9a06'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 637.742950] nova-scheduler[52181]: INFO nova.filters [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Filtering removed all hosts for the request with instance ID 'b7b62f1a-ec58-4f3f-9551-2643486c9a06'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 637.743256] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 637.743422] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-979f52d5-2704-410c-a030-533088e0674f tempest-ListServersNegativeTestJSON-445050069 tempest-ListServersNegativeTestJSON-445050069-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 637.947586] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Starting to schedule for instances: ['2baf0578-0f53-4cc3-98dd-6e77cc05172f'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 637.947586] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 637.947586] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.947770] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.947954] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.948868] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 637.999958] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.000417] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.000648] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.008845] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.009088] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.009261] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.012008] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.012219] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.012584] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 638.012866] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 638.013044] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 638.013202] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 638.013363] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.013625] nova-scheduler[52185]: DEBUG nova.filters [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 638.013833] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 83.875585 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 638.013988] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 638.014237] nova-scheduler[52185]: INFO nova.filters [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filter ComputeFilter returned 0 hosts [ 638.014392] nova-scheduler[52185]: DEBUG nova.filters [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filtering removed all hosts for the request with instance ID '2baf0578-0f53-4cc3-98dd-6e77cc05172f'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 638.014531] nova-scheduler[52185]: INFO nova.filters [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filtering removed all hosts for the request with instance ID '2baf0578-0f53-4cc3-98dd-6e77cc05172f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 638.014674] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 638.014889] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-afe55a09-b0be-43b7-abe3-c894d28bbd20 tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 638.791862] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Starting to schedule for instances: ['570f2695-73bf-433a-aac6-757a8c0cc2be'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 638.792186] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 638.792351] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.792526] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.793039] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.793039] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 638.846699] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.848099] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.848099] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.859195] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.859195] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.859195] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.865341] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.865722] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.866282] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 638.866737] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 638.867077] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 638.867376] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 638.867798] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.868313] nova-scheduler[52181]: DEBUG nova.filters [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 638.868627] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 84.730342 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 638.868902] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 638.869215] nova-scheduler[52181]: INFO nova.filters [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filter ComputeFilter returned 0 hosts [ 638.869487] nova-scheduler[52181]: DEBUG nova.filters [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filtering removed all hosts for the request with instance ID '570f2695-73bf-433a-aac6-757a8c0cc2be'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 638.870947] nova-scheduler[52181]: INFO nova.filters [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filtering removed all hosts for the request with instance ID '570f2695-73bf-433a-aac6-757a8c0cc2be'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 638.870947] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 638.870947] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-ad904beb-39e1-46f2-915a-d3f71408a48e tempest-VolumesAdminNegativeTest-1823021191 tempest-VolumesAdminNegativeTest-1823021191-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 640.134385] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Starting to schedule for instances: ['2f448ac7-9602-4f67-86d2-5a08f2e8073d'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 640.134804] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 640.135185] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 640.135405] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 640.135618] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 640.135802] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 640.189960] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 640.190278] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 640.190460] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 640.197772] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 640.201018] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 640.201018] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 640.201018] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 640.201307] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 640.201307] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 640.201464] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 640.201464] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 640.201464] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 640.202025] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 640.202025] nova-scheduler[52185]: DEBUG nova.filters [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 640.202193] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 86.063806 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 640.202298] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 640.202402] nova-scheduler[52185]: INFO nova.filters [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Filter ComputeFilter returned 0 hosts [ 640.202544] nova-scheduler[52185]: DEBUG nova.filters [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Filtering removed all hosts for the request with instance ID '2f448ac7-9602-4f67-86d2-5a08f2e8073d'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 640.202674] nova-scheduler[52185]: INFO nova.filters [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Filtering removed all hosts for the request with instance ID '2f448ac7-9602-4f67-86d2-5a08f2e8073d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 640.202815] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 640.202981] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-46552b67-e28c-4402-a7bc-8109cb4e6d4a tempest-AttachInterfacesUnderV243Test-691100930 tempest-AttachInterfacesUnderV243Test-691100930-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 641.313370] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Starting to schedule for instances: ['12f98059-926e-4975-bb9f-140a81140a98'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 641.313370] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 641.313370] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 641.313713] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 641.313713] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 641.313989] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 641.366859] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 641.367189] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 641.367420] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 641.374998] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 641.375337] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 641.375468] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 641.379200] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 641.379200] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 641.379428] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 641.379428] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 641.379538] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 641.379538] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 641.379637] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 641.379810] nova-scheduler[52181]: DEBUG nova.filters [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 641.380025] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 87.241768 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 641.380180] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 641.380330] nova-scheduler[52181]: INFO nova.filters [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Filter ComputeFilter returned 0 hosts [ 641.380480] nova-scheduler[52181]: DEBUG nova.filters [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Filtering removed all hosts for the request with instance ID '12f98059-926e-4975-bb9f-140a81140a98'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 641.380608] nova-scheduler[52181]: INFO nova.filters [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Filtering removed all hosts for the request with instance ID '12f98059-926e-4975-bb9f-140a81140a98'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 641.380750] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 641.380908] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-62ee7594-9004-41c3-be79-aae9b0a1282f tempest-ServerActionsTestJSON-1327811557 tempest-ServerActionsTestJSON-1327811557-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 641.900734] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Starting to schedule for instances: ['6803e9ad-3c77-4ab0-8330-52fd4c143539'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 641.901031] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 641.901195] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 641.901368] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 641.901568] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 641.901745] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 641.959292] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 641.959528] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 641.959694] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 641.970560] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 641.970787] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 641.970955] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 641.973031] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 641.973242] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 641.974576] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 641.974962] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 641.975431] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 641.975754] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 641.975832] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 641.976253] nova-scheduler[52185]: DEBUG nova.filters [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 641.976324] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 87.838058 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 641.976461] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 641.976615] nova-scheduler[52185]: INFO nova.filters [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filter ComputeFilter returned 0 hosts [ 641.976763] nova-scheduler[52185]: DEBUG nova.filters [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filtering removed all hosts for the request with instance ID '6803e9ad-3c77-4ab0-8330-52fd4c143539'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 641.976987] nova-scheduler[52185]: INFO nova.filters [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filtering removed all hosts for the request with instance ID '6803e9ad-3c77-4ab0-8330-52fd4c143539'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 641.977202] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 641.977929] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-58ea8be3-d439-467a-82d5-9770a1ca03ac tempest-ListImageFiltersTestJSON-70896247 tempest-ListImageFiltersTestJSON-70896247-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 644.545024] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting to schedule for instances: ['94c10ac0-bca0-4e76-8f47-f191809c7386'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 644.545024] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 644.545024] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.545024] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.545024] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.545502] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 644.587275] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.587566] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.587739] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.594383] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.594609] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.594754] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.596922] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.597138] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.597677] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 644.597796] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 644.597947] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 644.598650] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 644.598650] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.598650] nova-scheduler[52181]: DEBUG nova.filters [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 644.598818] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 90.46046 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 644.598861] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 644.599042] nova-scheduler[52181]: INFO nova.filters [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ComputeFilter returned 0 hosts [ 644.599182] nova-scheduler[52181]: DEBUG nova.filters [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtering removed all hosts for the request with instance ID '94c10ac0-bca0-4e76-8f47-f191809c7386'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 644.599326] nova-scheduler[52181]: INFO nova.filters [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtering removed all hosts for the request with instance ID '94c10ac0-bca0-4e76-8f47-f191809c7386'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 644.599503] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 644.599795] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5d6cedec-fbbf-4fcc-93f0-1a8d332e2d5c tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 647.645618] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Starting to schedule for instances: ['8db450a6-1ca0-40d3-9350-a637df87d73c'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 647.645858] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 647.645908] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.647786] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.647786] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.647786] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 647.712278] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.712278] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.712278] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.719454] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.719454] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.719454] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.722178] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.722529] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.722870] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 647.723137] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 647.723301] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 647.724909] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 647.725098] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.726036] nova-scheduler[52185]: DEBUG nova.filters [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 647.726036] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 93.587333 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 647.726036] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 647.726036] nova-scheduler[52185]: INFO nova.filters [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Filter ComputeFilter returned 0 hosts [ 647.726036] nova-scheduler[52185]: DEBUG nova.filters [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Filtering removed all hosts for the request with instance ID '8db450a6-1ca0-40d3-9350-a637df87d73c'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 647.726258] nova-scheduler[52185]: INFO nova.filters [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Filtering removed all hosts for the request with instance ID '8db450a6-1ca0-40d3-9350-a637df87d73c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 647.726335] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 647.726465] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f898dce4-2a4e-494b-bd4f-e364d154b03c tempest-ServersTestBootFromVolume-1072843563 tempest-ServersTestBootFromVolume-1072843563-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 651.586027] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Starting to schedule for instances: ['60ff0caf-22be-402f-a8a5-2773473bb595'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 651.586348] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 651.586516] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.586692] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.586885] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.588023] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 651.646018] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.646018] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.646018] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.650270] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.650475] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.650642] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.652815] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.653026] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.653387] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 651.653724] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 651.653890] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 651.654061] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 651.654231] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.654528] nova-scheduler[52181]: DEBUG nova.filters [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 651.654737] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 97.516488 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 651.654888] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 651.656126] nova-scheduler[52181]: INFO nova.filters [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Filter ComputeFilter returned 0 hosts [ 651.659022] nova-scheduler[52181]: DEBUG nova.filters [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Filtering removed all hosts for the request with instance ID '60ff0caf-22be-402f-a8a5-2773473bb595'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 651.659022] nova-scheduler[52181]: INFO nova.filters [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Filtering removed all hosts for the request with instance ID '60ff0caf-22be-402f-a8a5-2773473bb595'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 651.659022] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 651.659234] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-138d04e6-8688-4e12-bdd8-dd2fe2b10960 tempest-ImagesOneServerNegativeTestJSON-1401557552 tempest-ImagesOneServerNegativeTestJSON-1401557552-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 652.545263] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Starting to schedule for instances: ['2238169e-62f9-4d10-8d24-98a455e2be3d'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 652.545502] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 652.545541] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.545715] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.545881] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.547875] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 652.594708] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.595059] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.595447] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.604441] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.604441] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.604441] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.606376] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.606976] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.607414] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 652.607765] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 652.607964] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 652.608360] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 652.608471] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.608840] nova-scheduler[52185]: DEBUG nova.filters [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 652.609050] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 98.470741 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 652.609412] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 652.609626] nova-scheduler[52185]: INFO nova.filters [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ComputeFilter returned 0 hosts [ 652.609804] nova-scheduler[52185]: DEBUG nova.filters [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filtering removed all hosts for the request with instance ID '2238169e-62f9-4d10-8d24-98a455e2be3d'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 652.609979] nova-scheduler[52185]: INFO nova.filters [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filtering removed all hosts for the request with instance ID '2238169e-62f9-4d10-8d24-98a455e2be3d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 652.610206] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 652.610394] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-f0c3c2e3-70b9-4508-bd71-c75fe6064932 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 653.395330] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Starting to schedule for instances: ['c83f2531-e9ca-439d-b46f-33b3c7603a69'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 653.395635] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 653.395815] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.396019] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.396358] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.396560] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 653.446543] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.446919] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.447062] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.455485] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.455485] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.455485] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.462031] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.462352] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.462597] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 653.462897] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 653.463088] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 653.463328] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 653.463410] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.463685] nova-scheduler[52181]: DEBUG nova.filters [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 653.464766] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 99.326433 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 653.464947] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 653.465119] nova-scheduler[52181]: INFO nova.filters [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Filter ComputeFilter returned 0 hosts [ 653.465279] nova-scheduler[52181]: DEBUG nova.filters [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Filtering removed all hosts for the request with instance ID 'c83f2531-e9ca-439d-b46f-33b3c7603a69'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 653.465423] nova-scheduler[52181]: INFO nova.filters [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Filtering removed all hosts for the request with instance ID 'c83f2531-e9ca-439d-b46f-33b3c7603a69'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 653.465575] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 653.465725] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-d631864b-0dd4-4cdc-b74e-7396beed2cc6 tempest-InstanceActionsV221TestJSON-1778790919 tempest-InstanceActionsV221TestJSON-1778790919-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 658.384566] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Starting to schedule for instances: ['39537c41-7d28-443c-85f2-b5e170b6b0d2'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 658.384846] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 658.385012] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.385212] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.385430] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.385648] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 658.431653] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.432743] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.432743] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.447795] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.448507] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.448713] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.451940] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.453309] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.453309] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 658.454067] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 658.454067] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 658.454523] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 658.454798] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.455213] nova-scheduler[52185]: DEBUG nova.filters [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 658.455291] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 104.316974 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 658.455405] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 658.455571] nova-scheduler[52185]: INFO nova.filters [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Filter ComputeFilter returned 0 hosts [ 658.455722] nova-scheduler[52185]: DEBUG nova.filters [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Filtering removed all hosts for the request with instance ID '39537c41-7d28-443c-85f2-b5e170b6b0d2'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 658.455860] nova-scheduler[52185]: INFO nova.filters [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Filtering removed all hosts for the request with instance ID '39537c41-7d28-443c-85f2-b5e170b6b0d2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 658.456017] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 658.456376] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-b942a7e4-b34b-4577-813d-9da94d7294c4 tempest-ServersNegativeTestMultiTenantJSON-947424472 tempest-ServersNegativeTestMultiTenantJSON-947424472-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.026548] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Starting to schedule for instances: ['c34cfa49-bc27-47e4-8b66-fb9b3a60537e'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.026887] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.027013] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.027201] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.027398] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.027580] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.083867] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.084165] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.085265] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.102437] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.102437] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.102437] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.104364] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.104603] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.105024] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.105351] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.105553] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.105738] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.105929] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.106252] nova-scheduler[52181]: DEBUG nova.filters [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.106500] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 105.968241 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.106686] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 660.106866] nova-scheduler[52181]: INFO nova.filters [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Filter ComputeFilter returned 0 hosts [ 660.107054] nova-scheduler[52181]: DEBUG nova.filters [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Filtering removed all hosts for the request with instance ID 'c34cfa49-bc27-47e4-8b66-fb9b3a60537e'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.107219] nova-scheduler[52181]: INFO nova.filters [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Filtering removed all hosts for the request with instance ID 'c34cfa49-bc27-47e4-8b66-fb9b3a60537e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.107394] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.107590] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-10ad097b-1b0f-4e9d-8c1f-71846c93624f tempest-InstanceActionsTestJSON-177862478 tempest-InstanceActionsTestJSON-177862478-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 661.974674] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting to schedule for instances: ['c019a6d1-1d6b-4af0-9124-36daa10e5813'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 661.975096] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 661.980192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.980192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.980192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.980192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 662.048861] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.049110] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.049334] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.057028] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.057184] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.057372] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.059418] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.059611] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.060014] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 662.060314] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 662.060483] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 662.060639] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 662.062217] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.062217] nova-scheduler[52185]: DEBUG nova.filters [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 662.062217] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 107.923027 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 662.062217] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 662.062217] nova-scheduler[52185]: INFO nova.filters [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeFilter returned 0 hosts [ 662.062418] nova-scheduler[52185]: DEBUG nova.filters [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtering removed all hosts for the request with instance ID 'c019a6d1-1d6b-4af0-9124-36daa10e5813'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 662.062418] nova-scheduler[52185]: INFO nova.filters [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtering removed all hosts for the request with instance ID 'c019a6d1-1d6b-4af0-9124-36daa10e5813'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 662.062418] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 662.062418] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3e81727d-d345-4ad9-8326-3329600a6291 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 666.407597] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting to schedule for instances: ['d725ec92-b70d-4567-8f9a-ac90a71066fc'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 666.407868] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 666.407919] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.408282] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.408359] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.408752] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 666.466819] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.466819] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.466819] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.472475] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.472729] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.472873] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.475025] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.475151] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.475560] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='6',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_33983ea7f05b435da567e01fa0715162='0',num_proj_5275c625e8af40b28d4612c1473115df='0',num_proj_859a3caa90ab40879a27f7eb2ba8908b='0',num_proj_bd26fa229f324ee7aca2569d83ed0032='0',num_proj_fc4180d54c1c427081e8004cc159478f='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:03:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 666.475854] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 666.476531] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 666.476531] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 666.476531] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.476765] nova-scheduler[52181]: DEBUG nova.filters [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 666.476864] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 112.338607 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 666.477026] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 666.477492] nova-scheduler[52181]: INFO nova.filters [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filter ComputeFilter returned 0 hosts [ 666.477492] nova-scheduler[52181]: DEBUG nova.filters [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtering removed all hosts for the request with instance ID 'd725ec92-b70d-4567-8f9a-ac90a71066fc'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 666.477492] nova-scheduler[52181]: INFO nova.filters [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtering removed all hosts for the request with instance ID 'd725ec92-b70d-4567-8f9a-ac90a71066fc'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 666.477796] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 666.478294] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4483b7a6-787d-4174-935d-32d072eafbbd tempest-ImagesTestJSON-1759893354 tempest-ImagesTestJSON-1759893354-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 666.776580] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.777260] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.777955] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.778228] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.778314] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.778387] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.778474] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.778612] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.778612] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.778612] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.781426] nova-scheduler[52185]: INFO nova.scheduler.host_manager [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 666.781426] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.783585] nova-scheduler[52181]: INFO nova.scheduler.host_manager [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 666.784123] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-1ceb3bf4-7f43-4da6-81ef-198ad2703bdc None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.006s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.162194] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Starting to schedule for instances: ['420fda1a-e63f-40d0-9017-02e47576a94a'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 669.162433] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 669.162708] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.162943] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.163279] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.163346] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 669.217163] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.217485] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.217651] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.286791] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.286791] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.286791] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.286791] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.287317] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.287317] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:23Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 669.287521] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-15T19:04:19Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-773204222',updated_at=None,uuid=e7c3f152-76c7-48ff-9fd5-b0ec1a295503)] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 669.287521] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 669.287521] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 669.287702] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.287702] nova-scheduler[52185]: DEBUG nova.filters [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 669.287702] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 115.103383 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 669.287702] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 669.287702] nova-scheduler[52185]: INFO nova.filters [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter ComputeFilter returned 0 hosts [ 669.287863] nova-scheduler[52185]: DEBUG nova.filters [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filtering removed all hosts for the request with instance ID '420fda1a-e63f-40d0-9017-02e47576a94a'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 669.287863] nova-scheduler[52185]: INFO nova.filters [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filtering removed all hosts for the request with instance ID '420fda1a-e63f-40d0-9017-02e47576a94a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 669.287863] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 669.287863] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9b1525f7-b524-4862-add9-8cf08c472273 tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 671.361130] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Starting to schedule for instances: ['9f8485b1-6863-4f17-aff8-e5e878ac521b'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 671.361849] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 671.361849] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.361849] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.361945] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.362104] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 671.422487] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.422487] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.422487] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.428775] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.428991] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.429170] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.431368] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.431592] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.431944] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:23Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 671.432311] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-15T19:04:19Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-773204222',updated_at=None,uuid=e7c3f152-76c7-48ff-9fd5-b0ec1a295503)] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 671.432491] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 671.432647] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 671.432833] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.433118] nova-scheduler[52181]: DEBUG nova.filters [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 671.433331] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 117.29508 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 671.433497] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 671.433629] nova-scheduler[52181]: INFO nova.filters [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Filter ComputeFilter returned 0 hosts [ 671.433809] nova-scheduler[52181]: DEBUG nova.filters [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Filtering removed all hosts for the request with instance ID '9f8485b1-6863-4f17-aff8-e5e878ac521b'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 671.433995] nova-scheduler[52181]: INFO nova.filters [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Filtering removed all hosts for the request with instance ID '9f8485b1-6863-4f17-aff8-e5e878ac521b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 671.434208] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 671.434367] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-0802554e-ee14-4b64-94b7-db29bd57753f tempest-ServersTestJSON-2042308697 tempest-ServersTestJSON-2042308697-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 674.150032] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Starting to schedule for instances: ['474624ad-0060-410f-8a65-50f3fa3cc4d0'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 674.150557] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 674.150557] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.150557] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.150753] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.150946] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 674.208261] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.208261] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.208261] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.215920] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.216078] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.216780] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.218328] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.218991] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.218991] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:23Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 674.219259] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-15T19:04:19Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-773204222',updated_at=None,uuid=e7c3f152-76c7-48ff-9fd5-b0ec1a295503)] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 674.219478] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 2, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 674.219640] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 674.219806] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.220091] nova-scheduler[52185]: DEBUG nova.filters [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 674.220558] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:02:29. Elapsed time is 120.08205 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 674.220558] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 674.220641] nova-scheduler[52185]: INFO nova.filters [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter ComputeFilter returned 0 hosts [ 674.220770] nova-scheduler[52185]: DEBUG nova.filters [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filtering removed all hosts for the request with instance ID '474624ad-0060-410f-8a65-50f3fa3cc4d0'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 674.223708] nova-scheduler[52185]: INFO nova.filters [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filtering removed all hosts for the request with instance ID '474624ad-0060-410f-8a65-50f3fa3cc4d0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 674.223708] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 674.223708] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a9f8336c-7661-4643-965b-fc0a899fdd61 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 677.346872] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting to schedule for instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 677.347183] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 677.352236] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.352535] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.352761] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.352978] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 677.429157] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.429522] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.429698] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.438129] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.438374] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.438520] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.441308] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.441487] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.444752] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:23Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 677.444752] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 677.444844] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 677.444844] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with instances: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 677.444844] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.444961] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 677.444961] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.444961] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.444961] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.444961] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.445103] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.445103] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.445103] nova-scheduler[52181]: DEBUG nova.filters [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.445370] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 677.445430] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 677.445599] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Attempting to claim resources in the placement API for instance e46ad9d2-d215-4205-b0c1-44726b08cb45 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 677.518914] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] [instance: e46ad9d2-d215-4205-b0c1-44726b08cb45] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 677.519328] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.519474] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.519747] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f150b914-55df-4af9-b649-b789a293f473 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.686089] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Starting to schedule for instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 677.686395] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 677.686549] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.688485] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.688485] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.688485] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 677.754832] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.755170] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.755263] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.765620] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.765620] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.765620] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.770786] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.771192] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.771609] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:23Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=0) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 677.771879] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 677.772057] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 677.772209] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state with instances: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 677.772495] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.772666] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 677.772895] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.773117] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.773394] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.773605] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.773739] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.774293] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.774498] nova-scheduler[52185]: DEBUG nova.filters [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 677.774737] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 677.774853] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 677.775058] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Attempting to claim resources in the placement API for instance 7466dfd3-8756-40eb-91fd-c87f16b627ef {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 677.857354] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] [instance: 7466dfd3-8756-40eb-91fd-c87f16b627ef] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 677.857656] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.857938] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.858066] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-436b2d56-1260-4986-ae3c-b0d3c111722e tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.138779] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Starting to schedule for instances: ['68545276-63f2-4baf-8110-d3cc71686682'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 680.138988] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 680.140028] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.140028] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.140028] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.140028] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 680.180147] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.180402] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.180555] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.188175] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.188614] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.188614] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.190780] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.190982] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.191361] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='7',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:33Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=2) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 680.191666] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 680.191840] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 680.191996] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 680.192173] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.192424] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 680.192629] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.192808] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.193013] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.193185] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.193346] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.193515] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.193763] nova-scheduler[52181]: DEBUG nova.filters [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.193829] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 680.193996] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 680.194218] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Attempting to claim resources in the placement API for instance 68545276-63f2-4baf-8110-d3cc71686682 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 680.235151] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Starting to schedule for instances: ['b1361aa5-9bbd-4891-b74f-a0afd90b0bd6'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 680.235444] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 680.235594] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.235761] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.235942] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 680.236827] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 680.274375] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] [instance: 68545276-63f2-4baf-8110-d3cc71686682] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 680.274675] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.275214] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.275443] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-95589ff0-2ae0-4df8-9925-f5d63a2665fe tempest-ServerDiagnosticsV248Test-1137552807 tempest-ServerDiagnosticsV248Test-1137552807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.311308] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.311308] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.311308] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.322151] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.322151] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.322151] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.325051] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.325581] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.325796] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='7',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:33Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=2) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 680.327617] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 680.327617] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 680.327617] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 680.328011] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 680.328011] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 680.328011] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328011] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328011] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328174] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328174] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328174] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328174] nova-scheduler[52185]: DEBUG nova.filters [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 680.328174] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 680.328318] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 680.328468] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Attempting to claim resources in the placement API for instance b1361aa5-9bbd-4891-b74f-a0afd90b0bd6 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 680.385460] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] [instance: b1361aa5-9bbd-4891-b74f-a0afd90b0bd6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 680.385460] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 680.385886] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 680.385886] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e12515a2-ed4a-472a-90a9-ba6e4491eab9 tempest-ServerShowV247Test-916977799 tempest-ServerShowV247Test-916977799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.959787] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Starting to schedule for instances: ['4c545ed0-7442-43db-a96f-4d7f1b785c4d'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 682.960118] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 682.960278] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.960600] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.960741] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.960940] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 683.016313] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.016666] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.018771] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.030987] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.032825] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.032825] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.037710] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.042137] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.042632] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='7',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:35Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 683.042940] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 683.043123] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 683.043272] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 683.043439] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.006s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.043775] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 683.043987] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.044181] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.044379] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.044538] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.044695] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.044859] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.045049] nova-scheduler[52181]: DEBUG nova.filters [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.045205] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 683.045375] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 683.045625] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Attempting to claim resources in the placement API for instance 4c545ed0-7442-43db-a96f-4d7f1b785c4d {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 683.119252] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] [instance: 4c545ed0-7442-43db-a96f-4d7f1b785c4d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 683.122737] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.122737] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.122737] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-932f1f02-6b5d-44c3-a7cc-23843d41d098 tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.968370] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Starting to schedule for instances: ['6c8194c3-68fd-4ffc-a0fa-f23c8935bee6'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 684.971981] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 684.971981] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.971981] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.971981] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.971981] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 685.025973] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.026289] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.026477] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.034109] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.034323] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.034666] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.036865] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.036900] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.037268] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='7',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:38Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=5) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 685.037586] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 685.038448] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 685.038448] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '4c545ed0-7442-43db-a96f-4d7f1b785c4d'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 685.038448] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.038657] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 685.038725] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.038903] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.039108] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.039271] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.039453] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.039621] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.039778] nova-scheduler[52185]: DEBUG nova.filters [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 685.039930] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 685.040109] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 685.040286] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Attempting to claim resources in the placement API for instance 6c8194c3-68fd-4ffc-a0fa-f23c8935bee6 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 685.109935] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] [instance: 6c8194c3-68fd-4ffc-a0fa-f23c8935bee6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 685.110249] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.110470] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.110671] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d96c0ced-f062-463d-ae0d-4400b83d8169 tempest-ServerShowV254Test-893530536 tempest-ServerShowV254Test-893530536-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.879254] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Starting to schedule for instances: ['5980cfa0-bdd6-4fca-a605-c857e0e7b886'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 689.879618] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 689.879778] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.879969] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.880157] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.880575] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 689.926559] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.926813] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.926980] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.934087] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.934830] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.935098] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.940710] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.943018] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.943018] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='7',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:40Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=6) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 689.943183] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 689.943183] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 689.943183] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '4c545ed0-7442-43db-a96f-4d7f1b785c4d', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 689.943315] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.943315] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 689.943315] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943315] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943315] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943455] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943455] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943455] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943527] nova-scheduler[52181]: DEBUG nova.filters [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 689.943664] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 689.943822] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 689.943992] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Attempting to claim resources in the placement API for instance 5980cfa0-bdd6-4fca-a605-c857e0e7b886 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 689.999995] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] [instance: 5980cfa0-bdd6-4fca-a605-c857e0e7b886] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 689.999995] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.999995] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.000175] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-6a659fcc-5f6c-43fa-af74-873b3ff2b4a5 tempest-ServerPasswordTestJSON-1791643214 tempest-ServerPasswordTestJSON-1791643214-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.134013] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Starting to schedule for instances: ['5ada08c2-ea12-4b16-9384-af545c8e06aa'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 691.134945] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 691.135386] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.135693] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.136198] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.136414] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 691.208698] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.208934] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.209123] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.216389] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.216703] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.216771] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.219807] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.220118] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.220523] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='7',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_39a67a0257094a479656d0975c7f2127='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:45Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=7) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 691.220828] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 691.220999] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 691.221169] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '4c545ed0-7442-43db-a96f-4d7f1b785c4d', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '5980cfa0-bdd6-4fca-a605-c857e0e7b886'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 691.221331] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.221583] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 691.221783] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.221959] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.222166] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.222329] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.222488] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.222650] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.222807] nova-scheduler[52185]: DEBUG nova.filters [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.222956] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 691.223857] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 691.224066] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Attempting to claim resources in the placement API for instance 5ada08c2-ea12-4b16-9384-af545c8e06aa {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 691.290321] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] [instance: 5ada08c2-ea12-4b16-9384-af545c8e06aa] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 691.290764] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.290843] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.291052] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-73bbd370-d330-49ce-9037-38c4e2ad9cc4 tempest-ServerMetadataTestJSON-855428705 tempest-ServerMetadataTestJSON-855428705-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.221477] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Starting to schedule for instances: ['7e356a2e-b299-4801-af74-f536a12489fc'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 693.222475] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 693.223513] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.224093] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.224775] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.225361] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 693.280674] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.280674] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.280674] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.288314] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.288639] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.288877] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.291694] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.291777] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.292127] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='7',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='1',num_proj_39a67a0257094a479656d0975c7f2127='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:46Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 693.292420] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 693.293015] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 693.293015] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Update host state with instances: ['e46ad9d2-d215-4205-b0c1-44726b08cb45', '7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '4c545ed0-7442-43db-a96f-4d7f1b785c4d', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '5980cfa0-bdd6-4fca-a605-c857e0e7b886', '5ada08c2-ea12-4b16-9384-af545c8e06aa'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 693.293485] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.293485] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 693.293485] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.294470] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.294470] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.294470] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.294470] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.294470] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.294843] nova-scheduler[52181]: DEBUG nova.filters [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.295259] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 693.295259] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 693.295429] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Attempting to claim resources in the placement API for instance 7e356a2e-b299-4801-af74-f536a12489fc {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 693.371934] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] [instance: 7e356a2e-b299-4801-af74-f536a12489fc] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 693.372355] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.372454] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.372635] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-24b40525-bc39-4c67-8fb1-5b1623397163 tempest-ServersV294TestFqdnHostnames-1586253388 tempest-ServersV294TestFqdnHostnames-1586253388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.199532] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Starting to schedule for instances: ['e52a3adf-4654-43cd-8613-749277053ea8'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 696.203021] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 696.203021] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.203021] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.203021] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.203021] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 696.255521] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.255750] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.255945] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.265109] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.265109] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.265109] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.266982] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.267200] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.267636] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='7',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='1',num_proj_39a67a0257094a479656d0975c7f2127='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_df737b66de7f4333a492593a77abd42d='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:48Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 696.268264] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 696.268503] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 696.269354] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '4c545ed0-7442-43db-a96f-4d7f1b785c4d', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '5980cfa0-bdd6-4fca-a605-c857e0e7b886', '5ada08c2-ea12-4b16-9384-af545c8e06aa', '7e356a2e-b299-4801-af74-f536a12489fc'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 696.269354] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.269354] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 696.269354] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.269553] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.269869] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.269869] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.270067] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.271179] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.271179] nova-scheduler[52185]: DEBUG nova.filters [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.271179] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 696.271179] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 696.271908] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Attempting to claim resources in the placement API for instance e52a3adf-4654-43cd-8613-749277053ea8 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 696.338153] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] [instance: e52a3adf-4654-43cd-8613-749277053ea8] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 696.338380] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.338589] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.338795] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-e294a58d-5428-4f1a-816a-e9e5a9a27f37 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.503430] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Starting to schedule for instances: ['ef7b219e-437d-4b15-b559-ca5e2405efb2'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 696.503781] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 696.503951] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.505588] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.508425] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.508986] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 696.568835] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.568835] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.568835] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.575487] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.575702] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.575862] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.578130] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.578341] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.578698] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='7',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='1',num_proj_39a67a0257094a479656d0975c7f2127='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_df737b66de7f4333a492593a77abd42d='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:48Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 696.579115] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 696.579331] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 696.579465] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '4c545ed0-7442-43db-a96f-4d7f1b785c4d', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '5980cfa0-bdd6-4fca-a605-c857e0e7b886', '5ada08c2-ea12-4b16-9384-af545c8e06aa', '7e356a2e-b299-4801-af74-f536a12489fc'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 696.579709] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.579882] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 696.580094] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.580277] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.580491] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.580666] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.580827] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.581072] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.581265] nova-scheduler[52181]: DEBUG nova.filters [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.581430] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 696.581632] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 696.581819] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Attempting to claim resources in the placement API for instance ef7b219e-437d-4b15-b559-ca5e2405efb2 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 696.651941] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] [instance: ef7b219e-437d-4b15-b559-ca5e2405efb2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 696.651941] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.651941] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.651941] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-85d39ece-81cb-4714-a505-602e6aa6d34a tempest-ServerRescueTestJSON-406518722 tempest-ServerRescueTestJSON-406518722-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.515116] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Starting to schedule for instances: ['9bee98ef-48b4-47e6-8afb-e535e58e50cb'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 698.515116] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 698.515116] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.515116] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.516378] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.516635] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 698.583053] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.583433] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.583521] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.592212] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.592625] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.592978] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.595719] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.596048] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.596346] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='8',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='1',num_proj_39a67a0257094a479656d0975c7f2127='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_df737b66de7f4333a492593a77abd42d='1',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:52Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 698.596630] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 698.596886] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 698.597286] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '5980cfa0-bdd6-4fca-a605-c857e0e7b886', '5ada08c2-ea12-4b16-9384-af545c8e06aa', '7e356a2e-b299-4801-af74-f536a12489fc', 'e52a3adf-4654-43cd-8613-749277053ea8', 'ef7b219e-437d-4b15-b559-ca5e2405efb2'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 698.597723] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.597975] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 698.598668] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.598668] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.598668] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.598796] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.598880] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.599051] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.599249] nova-scheduler[52185]: DEBUG nova.filters [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.600032] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 698.600032] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 698.600032] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Attempting to claim resources in the placement API for instance 9bee98ef-48b4-47e6-8afb-e535e58e50cb {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 698.651691] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] [instance: 9bee98ef-48b4-47e6-8afb-e535e58e50cb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 698.651691] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.651691] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.651925] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-616d50c4-67f7-421a-9f90-205c09c00959 tempest-ServersTestMultiNic-1861207233 tempest-ServersTestMultiNic-1861207233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.103021] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Starting to schedule for instances: ['9e88b24c-500d-4efb-8563-093dd4d0378d'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 699.104538] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 699.104538] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 699.104538] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 699.104538] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 699.104779] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 699.154129] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.154129] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.154129] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.162966] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.163214] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.163374] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.169552] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.169552] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.169845] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='8',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='1',num_proj_39a67a0257094a479656d0975c7f2127='1',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_df737b66de7f4333a492593a77abd42d='1',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:52Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 699.169915] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 699.170446] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 699.170648] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '5980cfa0-bdd6-4fca-a605-c857e0e7b886', '5ada08c2-ea12-4b16-9384-af545c8e06aa', '7e356a2e-b299-4801-af74-f536a12489fc', 'e52a3adf-4654-43cd-8613-749277053ea8', 'ef7b219e-437d-4b15-b559-ca5e2405efb2', '9bee98ef-48b4-47e6-8afb-e535e58e50cb'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 699.171110] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.171183] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 699.171383] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.171565] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.171760] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.171922] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.172269] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.172541] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.172674] nova-scheduler[52181]: DEBUG nova.filters [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 699.173214] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 699.173214] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 699.173412] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Attempting to claim resources in the placement API for instance 9e88b24c-500d-4efb-8563-093dd4d0378d {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 699.242054] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] [instance: 9e88b24c-500d-4efb-8563-093dd4d0378d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 699.242351] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.242906] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.243198] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c2451075-b3e5-46a7-bba0-62ebd8fee8f6 tempest-ServerMetadataNegativeTestJSON-885798172 tempest-ServerMetadataNegativeTestJSON-885798172-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.905574] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting to schedule for instances: ['c7cb800a-3634-44e4-bb18-fab9d2e86c7e', '8fcf260d-2796-4972-b217-95954e309a6e'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 702.905898] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 702.906613] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.906961] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.907306] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.907520] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 702.940857] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Starting to schedule for instances: ['c9c2d371-978e-4037-ba78-9b44f40765bd'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 702.941162] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 702.941324] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.942476] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.942724] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.943750] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 702.964285] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.964519] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.964676] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.972082] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.972082] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.972253] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.974808] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.975031] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.975414] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='9',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_df737b66de7f4333a492593a77abd42d='1',num_proj_f32917678ead4147ab017ac9de07a145='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:57Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 702.975696] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 702.975865] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 702.976034] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '7e356a2e-b299-4801-af74-f536a12489fc', 'e52a3adf-4654-43cd-8613-749277053ea8', 'ef7b219e-437d-4b15-b559-ca5e2405efb2', '9bee98ef-48b4-47e6-8afb-e535e58e50cb', '9e88b24c-500d-4efb-8563-093dd4d0378d'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 702.976201] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.976461] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 702.976820] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.976935] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.977146] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.977209] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.977377] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.977528] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.977766] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.978097] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 702.978171] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 702.978317] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Attempting to claim resources in the placement API for instance c7cb800a-3634-44e4-bb18-fab9d2e86c7e {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 703.013125] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.013518] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.013566] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.021632] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.021872] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.024028] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.024453] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.024655] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.025160] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='9',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_df737b66de7f4333a492593a77abd42d='1',num_proj_f32917678ead4147ab017ac9de07a145='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:57Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 703.025612] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 703.025700] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 703.025853] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '7e356a2e-b299-4801-af74-f536a12489fc', 'e52a3adf-4654-43cd-8613-749277053ea8', 'ef7b219e-437d-4b15-b559-ca5e2405efb2', '9bee98ef-48b4-47e6-8afb-e535e58e50cb', '9e88b24c-500d-4efb-8563-093dd4d0378d'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 703.026377] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.026659] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 703.026862] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.027146] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.027435] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.027544] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.027706] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.027892] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.028192] nova-scheduler[52181]: DEBUG nova.filters [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.028377] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 703.029086] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 703.029086] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Attempting to claim resources in the placement API for instance c9c2d371-978e-4037-ba78-9b44f40765bd {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 703.087029] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] [instance: c7cb800a-3634-44e4-bb18-fab9d2e86c7e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 703.087194] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.087653] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.087653] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.087788] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 703.088200] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.088200] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.088329] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 703.088577] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 703.088649] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Attempting to claim resources in the placement API for instance 8fcf260d-2796-4972-b217-95954e309a6e {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 703.164796] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] [instance: 8fcf260d-2796-4972-b217-95954e309a6e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 703.165229] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.165569] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.165818] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.166103] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 703.166385] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.166644] nova-scheduler[52185]: DEBUG nova.filters [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 703.166883] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 703.167185] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-0e92c309-cbac-45de-8e98-2aaf7268129d tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 704.108019] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] [instance: c9c2d371-978e-4037-ba78-9b44f40765bd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 704.108019] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 704.108019] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 704.108405] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-c6361768-afea-4756-bbb0-dabacec97540 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.132998] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Starting to schedule for instances: ['156cf534-81ca-4cc6-9b0d-2d245016c53c'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 705.132998] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 705.133308] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.133522] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.133744] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.134248] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 705.211898] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.212167] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.212352] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.222865] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.223176] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.223627] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.226796] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.226995] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.227404] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='11',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='1',num_proj_df737b66de7f4333a492593a77abd42d='1',num_proj_f32917678ead4147ab017ac9de07a145='1',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:04:59Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=10) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 705.227758] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 705.227867] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 705.228030] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'e52a3adf-4654-43cd-8613-749277053ea8', 'ef7b219e-437d-4b15-b559-ca5e2405efb2', '9bee98ef-48b4-47e6-8afb-e535e58e50cb', '9e88b24c-500d-4efb-8563-093dd4d0378d', 'c7cb800a-3634-44e4-bb18-fab9d2e86c7e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 705.228195] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.228897] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 705.228897] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.228897] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.229093] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.229534] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.229735] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.229906] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.230082] nova-scheduler[52185]: DEBUG nova.filters [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.230240] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 705.230408] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 705.230566] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Attempting to claim resources in the placement API for instance 156cf534-81ca-4cc6-9b0d-2d245016c53c {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 705.314715] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] [instance: 156cf534-81ca-4cc6-9b0d-2d245016c53c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 705.315083] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.315336] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.315569] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-3856ad9c-4c98-4f9f-9fa6-f556526fd8a6 tempest-ServerRescueNegativeTestJSON-1532022264 tempest-ServerRescueNegativeTestJSON-1532022264-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.892874] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Starting to schedule for instances: ['c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 706.892874] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 706.892874] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 706.892874] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 706.892874] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 706.894427] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 706.956832] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.957087] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.957261] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.964967] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.965273] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.965468] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.967944] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.968226] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.968659] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='11',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='1',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='1',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:00Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 706.968999] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 706.969223] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 706.969451] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'ef7b219e-437d-4b15-b559-ca5e2405efb2', '9bee98ef-48b4-47e6-8afb-e535e58e50cb', '9e88b24c-500d-4efb-8563-093dd4d0378d', 'c7cb800a-3634-44e4-bb18-fab9d2e86c7e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 706.969602] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.969920] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 706.970231] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.970707] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.970963] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.971189] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.971480] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.971707] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.971912] nova-scheduler[52181]: DEBUG nova.filters [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.972118] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 706.973073] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 706.973073] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Attempting to claim resources in the placement API for instance c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 707.031649] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] [instance: c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 707.032030] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 707.032814] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 707.032814] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-7e828195-3163-4e64-9ad9-2ccd9055d3d5 tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.933863] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Starting to schedule for instances: ['fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 709.934318] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 709.934511] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.935064] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.935315] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.935563] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 709.992136] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.992537] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.992755] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.001692] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.001952] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.002179] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.005271] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.005538] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.005945] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='14',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='1',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='1',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:04Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=10) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 710.006257] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 710.006424] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 710.006585] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '9bee98ef-48b4-47e6-8afb-e535e58e50cb', '9e88b24c-500d-4efb-8563-093dd4d0378d', 'c7cb800a-3634-44e4-bb18-fab9d2e86c7e', '8fcf260d-2796-4972-b217-95954e309a6e', 'c9c2d371-978e-4037-ba78-9b44f40765bd', '156cf534-81ca-4cc6-9b0d-2d245016c53c'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 710.006794] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.007631] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 710.007631] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.007631] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.007769] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.007826] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.007984] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.008734] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.008991] nova-scheduler[52185]: DEBUG nova.filters [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.009218] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 710.009426] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 710.009666] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Attempting to claim resources in the placement API for instance fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 710.059443] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] [instance: fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 710.059443] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.059443] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.059739] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-1b405b20-af63-4812-ba02-dc6023967f4b tempest-ListServerFiltersTestJSON-1580368180 tempest-ListServerFiltersTestJSON-1580368180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.220132] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting to schedule for instances: ['43fbb2e2-b827-4fc0-aff4-886a26f4550e'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 710.220132] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 710.220387] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 710.220666] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 710.220901] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 710.221145] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 710.279115] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.279362] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.281827] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.286550] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.286764] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.286931] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.289631] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.289838] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.291388] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='14',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='1',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='1',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:04Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=10) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 710.291544] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 710.291544] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 710.291544] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '9bee98ef-48b4-47e6-8afb-e535e58e50cb', '9e88b24c-500d-4efb-8563-093dd4d0378d', 'c7cb800a-3634-44e4-bb18-fab9d2e86c7e', '8fcf260d-2796-4972-b217-95954e309a6e', 'c9c2d371-978e-4037-ba78-9b44f40765bd', '156cf534-81ca-4cc6-9b0d-2d245016c53c'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 710.291766] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.291766] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 710.291766] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.291935] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.292041] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.292215] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.292639] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.292831] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.293009] nova-scheduler[52181]: DEBUG nova.filters [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.293181] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 710.293349] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 710.293527] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Attempting to claim resources in the placement API for instance 43fbb2e2-b827-4fc0-aff4-886a26f4550e {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 710.350154] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] [instance: 43fbb2e2-b827-4fc0-aff4-886a26f4550e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 710.350154] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.350154] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.350322] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-089040d8-fa96-4a76-be1b-d929bfa36203 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.028930] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Starting to schedule for instances: ['b01c69b3-eec6-4577-8288-d4602da9e251'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 712.032887] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 712.032887] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 712.032887] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 712.032887] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 712.032887] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 712.072177] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.072480] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.072650] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.081062] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.081266] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.081433] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.083790] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.083984] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.084348] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='14',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='1',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:06Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 712.084625] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 712.084791] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 712.084942] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '9e88b24c-500d-4efb-8563-093dd4d0378d', 'c7cb800a-3634-44e4-bb18-fab9d2e86c7e', '8fcf260d-2796-4972-b217-95954e309a6e', 'c9c2d371-978e-4037-ba78-9b44f40765bd', '156cf534-81ca-4cc6-9b0d-2d245016c53c'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 712.085115] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.085359] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 712.085554] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.085731] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.085919] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.086387] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.086593] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.086766] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.086962] nova-scheduler[52185]: DEBUG nova.filters [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.087736] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 712.087736] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 712.087736] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Attempting to claim resources in the placement API for instance b01c69b3-eec6-4577-8288-d4602da9e251 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 712.138622] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] [instance: b01c69b3-eec6-4577-8288-d4602da9e251] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 712.139320] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.139551] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.140442] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-d5dd79ad-47c2-4efe-b1c2-54c3c2bb9651 tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.058975] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Starting to schedule for instances: ['fc85402b-7fcc-4060-b16a-f82d70d6886b'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 714.059295] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 714.059454] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.060805] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.060805] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.060805] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 714.104314] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.104539] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.104708] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.112167] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.112382] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.112547] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.114822] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.115324] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.115498] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='15',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='2',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='0',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:08Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 714.116549] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 714.116549] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 714.116736] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'c7cb800a-3634-44e4-bb18-fab9d2e86c7e', '8fcf260d-2796-4972-b217-95954e309a6e', 'c9c2d371-978e-4037-ba78-9b44f40765bd', '156cf534-81ca-4cc6-9b0d-2d245016c53c', 'c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b', 'fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 714.116736] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.117018] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 714.117281] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.117508] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.117742] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.117960] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.118177] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.118433] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.118617] nova-scheduler[52181]: DEBUG nova.filters [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.118837] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 714.119034] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 714.119217] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Attempting to claim resources in the placement API for instance fc85402b-7fcc-4060-b16a-f82d70d6886b {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 714.184185] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] [instance: fc85402b-7fcc-4060-b16a-f82d70d6886b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 714.184844] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.187034] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.187034] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c4217d4-e9e0-46ea-830d-e5ef697e4504 tempest-ServerRescueTestJSONUnderV235-724313637 tempest-ServerRescueTestJSONUnderV235-724313637-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.717884] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Starting to schedule for instances: ['e75afc9c-035c-4926-b72a-d570b5f2e6f0'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 714.717884] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 714.719538] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.719851] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.720074] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.720876] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 714.778740] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.778957] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.779160] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.785813] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.786031] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.786195] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.788642] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.788895] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.789287] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194734,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1856,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='16',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='3',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='0',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:09Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=10) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 714.790623] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 714.790623] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 714.790623] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '8fcf260d-2796-4972-b217-95954e309a6e', 'c9c2d371-978e-4037-ba78-9b44f40765bd', '156cf534-81ca-4cc6-9b0d-2d245016c53c', 'c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b', 'fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 714.790924] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.790924] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 714.790924] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.790924] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.790924] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.791157] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.791273] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.791423] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.791584] nova-scheduler[52185]: DEBUG nova.filters [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.791762] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 714.791925] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 714.792105] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Attempting to claim resources in the placement API for instance e75afc9c-035c-4926-b72a-d570b5f2e6f0 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 714.860848] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] [instance: e75afc9c-035c-4926-b72a-d570b5f2e6f0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 714.861153] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.863025] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.863025] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-52da69a3-269c-4578-bdbd-d3c315a7f06e tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.649774] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Starting to schedule for instances: ['47d86b97-4bf1-40d4-b666-a530901d28dd'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 717.650127] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 717.650294] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.650473] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.650729] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.650845] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 717.701395] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.701626] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.701832] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.708734] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.708942] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.709124] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.711458] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.711671] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.712051] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194862,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1728,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='17',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='1',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='3',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='0',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:12Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 717.712336] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 717.712530] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 717.712702] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'c9c2d371-978e-4037-ba78-9b44f40765bd', '156cf534-81ca-4cc6-9b0d-2d245016c53c', 'c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b', 'fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2', '43fbb2e2-b827-4fc0-aff4-886a26f4550e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 717.712866] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.713166] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 717.713370] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.713552] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.713749] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.713917] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.714090] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.714256] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.714422] nova-scheduler[52181]: DEBUG nova.filters [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.714607] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 717.714785] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 717.714959] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Attempting to claim resources in the placement API for instance 47d86b97-4bf1-40d4-b666-a530901d28dd {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 717.764289] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] [instance: 47d86b97-4bf1-40d4-b666-a530901d28dd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194862MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 717.765095] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.765436] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.765773] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-351813c6-aeba-4a5e-822b-065981327928 tempest-ServersAdminTestJSON-1751613823 tempest-ServersAdminTestJSON-1751613823-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.945027] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Starting to schedule for instances: ['9614d3ee-0911-4b50-9875-93ef3f7f2b5f'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 722.945325] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 722.945483] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.947721] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.948055] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.948845] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 723.002420] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.002420] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.002587] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.009850] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.009928] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.010058] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.012903] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.013172] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.013582] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194734,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1856,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='20',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='0',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_33b22598eb074c35b7782df547b1cdea='1',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_65241354dfa84a61977e9f11a0483dc9='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='2',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a7f572f853ca47cd9a40604f8a7f6c36='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='0',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:16Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=10) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 723.013940] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 723.014175] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 723.014373] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'c3e9f1b6-5feb-4d0a-ac70-67918b66fb0b', 'fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2', '43fbb2e2-b827-4fc0-aff4-886a26f4550e', 'b01c69b3-eec6-4577-8288-d4602da9e251', 'fc85402b-7fcc-4060-b16a-f82d70d6886b', 'e75afc9c-035c-4926-b72a-d570b5f2e6f0'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 723.014565] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.014862] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 723.015155] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.015367] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.015613] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.015815] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.016058] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.016292] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.016490] nova-scheduler[52185]: DEBUG nova.filters [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.016680] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 723.016881] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 723.017099] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Attempting to claim resources in the placement API for instance 9614d3ee-0911-4b50-9875-93ef3f7f2b5f {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 723.071710] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] [instance: 9614d3ee-0911-4b50-9875-93ef3f7f2b5f] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 723.072066] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.072313] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.072516] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9d85b446-e533-4385-85de-1ac0d0f19f0b tempest-AttachInterfacesTestJSON-1051727072 tempest-AttachInterfacesTestJSON-1051727072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.282160] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Starting to schedule for instances: ['ab6859e4-807d-4b5f-943b-6491ed211c75'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 723.282497] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 723.282664] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 723.282842] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 723.285177] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 723.285556] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 723.344216] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.344432] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.347609] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.351587] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.351984] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.352077] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.354247] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.354533] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.354962] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194734,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1856,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='20',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_15c6dd50db8b44d190cdaaf8e69222da='0',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_33b22598eb074c35b7782df547b1cdea='1',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_65241354dfa84a61977e9f11a0483dc9='1',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='1',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='2',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a7f572f853ca47cd9a40604f8a7f6c36='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='0',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:16Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=10) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 723.355297] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 723.355499] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 723.355706] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'fd4ad598-3fa2-4a7a-9226-9cf9dba03ce2', '43fbb2e2-b827-4fc0-aff4-886a26f4550e', 'b01c69b3-eec6-4577-8288-d4602da9e251', 'fc85402b-7fcc-4060-b16a-f82d70d6886b', 'e75afc9c-035c-4926-b72a-d570b5f2e6f0'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 723.355904] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.356223] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 723.356448] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.356636] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.356831] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.356995] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.357260] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.357478] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.357703] nova-scheduler[52181]: DEBUG nova.filters [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.357920] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 723.358128] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 723.358339] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Attempting to claim resources in the placement API for instance ab6859e4-807d-4b5f-943b-6491ed211c75 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 723.421310] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] [instance: ab6859e4-807d-4b5f-943b-6491ed211c75] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194734MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 723.421310] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.421310] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.421548] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-84e10c45-1787-4e24-9273-ffcb4e8fc8ea tempest-ServerActionsTestOtherA-1143455132 tempest-ServerActionsTestOtherA-1143455132-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.306451] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Starting to schedule for instances: ['bd447698-8d52-4576-9d86-1a22e36bc3d5'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 728.307764] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 728.308102] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.308194] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.308449] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.308679] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 728.369836] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.370132] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.370767] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.381389] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.381389] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.381389] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.382598] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.382948] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.384394] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='22',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_15c6dd50db8b44d190cdaaf8e69222da='0',num_proj_1d1843cb3adc4fe59efbc5dd6a7c0f32='0',num_proj_33b22598eb074c35b7782df547b1cdea='1',num_proj_39a67a0257094a479656d0975c7f2127='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_61a1fea64b51425d840cb421206a4191='0',num_proj_65241354dfa84a61977e9f11a0483dc9='2',num_proj_8d75debce2fd4b2492cc02aeb2fed7fc='0',num_proj_9af4fbea46444d81b8ed5dd844ce87d4='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a7f572f853ca47cd9a40604f8a7f6c36='0',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='2',num_proj_b1fece12693747c2b6e56f92f305881f='0',num_proj_df737b66de7f4333a492593a77abd42d='0',num_proj_f32917678ead4147ab017ac9de07a145='0',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:22Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 728.384523] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 728.384523] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 728.384523] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Update host state with instances: ['7466dfd3-8756-40eb-91fd-c87f16b627ef', '68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'fc85402b-7fcc-4060-b16a-f82d70d6886b', 'e75afc9c-035c-4926-b72a-d570b5f2e6f0', '47d86b97-4bf1-40d4-b666-a530901d28dd', '9614d3ee-0911-4b50-9875-93ef3f7f2b5f'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 728.384698] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.385234] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 728.386501] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.386731] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.386933] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.387124] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.387295] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.387462] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.387658] nova-scheduler[52185]: DEBUG nova.filters [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.387820] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 728.387980] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 728.388152] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Attempting to claim resources in the placement API for instance bd447698-8d52-4576-9d86-1a22e36bc3d5 {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 728.466029] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] [instance: bd447698-8d52-4576-9d86-1a22e36bc3d5] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 728.466029] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.466029] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.466271] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-37b5320c-8cb9-46d1-9324-af075ff3ca1d tempest-SecurityGroupsTestJSON-1433999459 tempest-SecurityGroupsTestJSON-1433999459-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.218367] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Starting to schedule for instances: ['35cae673-166d-4ffc-90fb-aee3bdfd1710'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 730.218645] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 730.218801] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.218967] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.219642] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.220562] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 730.279697] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.279940] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.282560] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.288967] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.289242] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.289408] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.291900] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.292091] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.292451] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='24',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='2',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='1',num_proj_e05387f01e784108985ef588ab2b8094='1',num_task_None='2',num_task_spawning='6',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:24Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 730.292731] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 730.292897] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 730.293189] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'e75afc9c-035c-4926-b72a-d570b5f2e6f0', '47d86b97-4bf1-40d4-b666-a530901d28dd', '9614d3ee-0911-4b50-9875-93ef3f7f2b5f', 'ab6859e4-807d-4b5f-943b-6491ed211c75', 'bd447698-8d52-4576-9d86-1a22e36bc3d5'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 730.293280] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.293494] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 730.293754] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.293896] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.294187] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.294379] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.294570] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.294852] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.294906] nova-scheduler[52181]: DEBUG nova.filters [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.295048] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 730.295435] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 730.295435] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Attempting to claim resources in the placement API for instance 35cae673-166d-4ffc-90fb-aee3bdfd1710 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 730.371343] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] [instance: 35cae673-166d-4ffc-90fb-aee3bdfd1710] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 730.371660] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.371977] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.372432] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4b034ead-b341-4094-8a86-1293a94d7995 tempest-ImagesOneServerTestJSON-356266125 tempest-ImagesOneServerTestJSON-356266125-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.246106] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Starting to schedule for instances: ['946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 731.246462] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 731.246720] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.246786] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.246969] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.247157] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 731.299978] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.299978] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.299978] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.307643] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.309068] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.309330] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.313229] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.313448] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.314882] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='26',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_2d138ee86d5a4657a3c40323d42a362b='1',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='2',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='1',num_proj_e05387f01e784108985ef588ab2b8094='1',num_task_None='3',num_task_spawning='6',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:25Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 731.314882] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 731.315109] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 731.315109] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'e75afc9c-035c-4926-b72a-d570b5f2e6f0', '9614d3ee-0911-4b50-9875-93ef3f7f2b5f', 'ab6859e4-807d-4b5f-943b-6491ed211c75', 'bd447698-8d52-4576-9d86-1a22e36bc3d5', '35cae673-166d-4ffc-90fb-aee3bdfd1710'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 731.315216] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.315216] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.315292] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.315492] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.315848] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.315848] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.315922] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.316927] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.316927] nova-scheduler[52185]: DEBUG nova.filters [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.316927] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.317029] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 731.320260] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Attempting to claim resources in the placement API for instance 946c73f8-1ed8-4180-a9d7-0b2970c4367e {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 731.361981] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting to schedule for instances: ['73b58043-e025-48ff-a22a-4d226c545456', '031e33fa-92ab-483b-ab38-ecf3bbfd1374'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 731.363595] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 731.363595] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.363595] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.363595] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.363595] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 731.384407] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] [instance: 946c73f8-1ed8-4180-a9d7-0b2970c4367e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 731.385366] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.385665] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.387200] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-59a315b4-ab5c-4345-bdbe-05be08a4aa67 tempest-ServersAaction247Test-439800747 tempest-ServersAaction247Test-439800747-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.419022] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.419022] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.419366] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.427138] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.427408] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.427612] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.430260] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.430509] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.430963] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='26',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_2d138ee86d5a4657a3c40323d42a362b='1',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='1',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='1',num_proj_e05387f01e784108985ef588ab2b8094='1',num_task_None='3',num_task_spawning='5',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:26Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 731.431694] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 731.432063] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 731.432690] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'e75afc9c-035c-4926-b72a-d570b5f2e6f0', '9614d3ee-0911-4b50-9875-93ef3f7f2b5f', 'ab6859e4-807d-4b5f-943b-6491ed211c75', 'bd447698-8d52-4576-9d86-1a22e36bc3d5', '35cae673-166d-4ffc-90fb-aee3bdfd1710'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 731.432690] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.432690] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.432872] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433084] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433222] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433383] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433550] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433687] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433840] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.433994] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.434684] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 731.434965] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Attempting to claim resources in the placement API for instance 73b58043-e025-48ff-a22a-4d226c545456 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 731.518144] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] [instance: 73b58043-e025-48ff-a22a-4d226c545456] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 731.518144] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.518144] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.518324] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.518324] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.518324] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.518324] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.518324] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.518539] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 731.518539] nova-scheduler[52181]: DEBUG nova.scheduler.utils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Attempting to claim resources in the placement API for instance 031e33fa-92ab-483b-ab38-ecf3bbfd1374 {{(pid=52181) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 731.588317] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] [instance: 031e33fa-92ab-483b-ab38-ecf3bbfd1374] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52181) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 731.588870] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.589540] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.589540] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.589540] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.589708] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.589934] nova-scheduler[52181]: DEBUG nova.filters [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.590073] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.590404] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-5f5fea44-936f-46e8-9776-aee45b3037a5 tempest-MultipleCreateTestJSON-1686950820 tempest-MultipleCreateTestJSON-1686950820-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 733.420776] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Starting to schedule for instances: ['ad70ab2b-17e2-4cf1-9411-272aec5bfb8a'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 733.421120] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 733.421277] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 733.421446] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 733.421627] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 733.421796] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 733.477171] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 733.477434] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 733.477624] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 733.486249] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 733.487382] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 733.487382] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 733.490137] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 733.490137] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 733.490311] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='26',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='1',num_proj_2d138ee86d5a4657a3c40323d42a362b='1',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='1',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='1',num_task_None='4',num_task_spawning='4',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:27Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 733.490389] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 733.490389] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 733.490478] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '9614d3ee-0911-4b50-9875-93ef3f7f2b5f', 'ab6859e4-807d-4b5f-943b-6491ed211c75', 'bd447698-8d52-4576-9d86-1a22e36bc3d5', '35cae673-166d-4ffc-90fb-aee3bdfd1710', '946c73f8-1ed8-4180-a9d7-0b2970c4367e', '73b58043-e025-48ff-a22a-4d226c545456'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 733.490794] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 733.491582] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 733.491582] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.491582] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.491582] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.491811] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.491811] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.491935] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.492105] nova-scheduler[52185]: DEBUG nova.filters [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 733.492293] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 733.492454] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 733.492625] nova-scheduler[52185]: DEBUG nova.scheduler.utils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Attempting to claim resources in the placement API for instance ad70ab2b-17e2-4cf1-9411-272aec5bfb8a {{(pid=52185) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 733.579776] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] [instance: ad70ab2b-17e2-4cf1-9411-272aec5bfb8a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52185) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 733.580323] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 733.580725] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 733.581126] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-04286880-fda9-4f78-826e-74ba0d7d7596 tempest-ServersNegativeTestJSON-589792489 tempest-ServersNegativeTestJSON-589792489-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 734.977157] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting to schedule for instances: ['1997b816-146a-460b-b55d-664e5e228759'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 734.977157] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 734.977157] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 734.977157] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 734.977157] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 734.977596] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 735.032177] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.032658] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.032658] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.040200] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.040534] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.040656] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.043192] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.043460] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.043929] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='28',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='1',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='1',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='1',num_task_None='6',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:29Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=9) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 735.044268] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 735.044452] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 735.044615] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', 'ab6859e4-807d-4b5f-943b-6491ed211c75', 'bd447698-8d52-4576-9d86-1a22e36bc3d5', '35cae673-166d-4ffc-90fb-aee3bdfd1710', '946c73f8-1ed8-4180-a9d7-0b2970c4367e', '73b58043-e025-48ff-a22a-4d226c545456', '031e33fa-92ab-483b-ab38-ecf3bbfd1374'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 735.044777] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.045043] nova-scheduler[52181]: DEBUG nova.filters [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 735.045249] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 60.907001 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 735.045418] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 has not been heard from in a while [ 735.045548] nova-scheduler[52181]: INFO nova.filters [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeFilter returned 0 hosts [ 735.045690] nova-scheduler[52181]: DEBUG nova.filters [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtering removed all hosts for the request with instance ID '1997b816-146a-460b-b55d-664e5e228759'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 735.045830] nova-scheduler[52181]: INFO nova.filters [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtering removed all hosts for the request with instance ID '1997b816-146a-460b-b55d-664e5e228759'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 735.045973] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 735.046227] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2516b778-14fe-4c02-8d78-70287e90db00 tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 742.340015] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting to schedule for instances: ['f064209e-cc0b-4843-9b48-0ddf6cd80317'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 742.340015] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 742.340015] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.343243] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.343243] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.343243] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 742.383097] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.383097] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.383272] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.389639] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.389866] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.390054] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.392451] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.392652] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.393013] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='29',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='1',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='1',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='5',num_task_spawning='3',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:34Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=8) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 742.393452] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 742.393452] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 742.393611] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '35cae673-166d-4ffc-90fb-aee3bdfd1710', '946c73f8-1ed8-4180-a9d7-0b2970c4367e', '73b58043-e025-48ff-a22a-4d226c545456', '031e33fa-92ab-483b-ab38-ecf3bbfd1374', 'ad70ab2b-17e2-4cf1-9411-272aec5bfb8a'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 742.393769] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.394053] nova-scheduler[52185]: DEBUG nova.filters [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.394247] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 68.256 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 742.394400] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 742.394548] nova-scheduler[52185]: INFO nova.filters [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filter ComputeFilter returned 0 hosts [ 742.394687] nova-scheduler[52185]: DEBUG nova.filters [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtering removed all hosts for the request with instance ID 'f064209e-cc0b-4843-9b48-0ddf6cd80317'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 742.394819] nova-scheduler[52185]: INFO nova.filters [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtering removed all hosts for the request with instance ID 'f064209e-cc0b-4843-9b48-0ddf6cd80317'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 742.395208] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.395208] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-9ca38bf9-0a97-4e59-be1c-356eeb54f25e tempest-ServerDiskConfigTestJSON-249548930 tempest-ServerDiskConfigTestJSON-249548930-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 744.651580] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Starting to schedule for instances: ['a5ccea22-a4ca-4884-9efe-9d630038df57'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 744.651914] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 744.656471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 744.656471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 744.656471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 744.656471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 744.743404] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 744.743404] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 744.743404] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 744.761429] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 744.761615] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 744.761780] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 744.767962] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 744.768210] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 744.768604] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='31',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='2',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='1',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='4',num_task_spawning='3',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:38Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=7) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 744.768902] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 744.769086] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 744.769242] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e', '73b58043-e025-48ff-a22a-4d226c545456', '031e33fa-92ab-483b-ab38-ecf3bbfd1374', 'ad70ab2b-17e2-4cf1-9411-272aec5bfb8a'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 744.769404] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 744.769686] nova-scheduler[52181]: DEBUG nova.filters [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 744.769909] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 70.631647 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 744.770092] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 744.770251] nova-scheduler[52181]: INFO nova.filters [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filter ComputeFilter returned 0 hosts [ 744.770396] nova-scheduler[52181]: DEBUG nova.filters [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filtering removed all hosts for the request with instance ID 'a5ccea22-a4ca-4884-9efe-9d630038df57'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 744.770530] nova-scheduler[52181]: INFO nova.filters [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filtering removed all hosts for the request with instance ID 'a5ccea22-a4ca-4884-9efe-9d630038df57'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 744.770675] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 744.770839] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-549a115c-34af-469d-b82c-f2db27daea6d tempest-AttachVolumeTestJSON-1745626859 tempest-AttachVolumeTestJSON-1745626859-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 745.636751] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['3b4d70cf-f984-4c00-8882-a1e8f7b5f248'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 745.637075] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 745.637235] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 745.637407] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 745.637596] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 745.641022] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 745.691192] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 745.691611] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 745.691611] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 745.699677] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 745.703107] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 745.703360] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 745.708910] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 745.708910] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 745.709107] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='32',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='1',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='1',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='3',num_task_spawning='3',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:40Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=6) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 745.709181] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 745.709181] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 745.709181] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e', 'ad70ab2b-17e2-4cf1-9411-272aec5bfb8a'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 745.709313] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 745.709313] nova-scheduler[52185]: DEBUG nova.filters [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 745.709313] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 71.569705 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 745.709313] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 745.709313] nova-scheduler[52185]: INFO nova.filters [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 745.709579] nova-scheduler[52185]: DEBUG nova.filters [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '3b4d70cf-f984-4c00-8882-a1e8f7b5f248'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 745.709579] nova-scheduler[52185]: INFO nova.filters [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '3b4d70cf-f984-4c00-8882-a1e8f7b5f248'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 745.709579] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 745.709579] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a7bb380c-abec-4fbe-b0e4-15b7317abc5b tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 748.148999] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Starting to schedule for instances: ['ca375850-3a4b-4c6f-8ec8-5708dc2f936e'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 748.149420] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 748.149568] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 748.149771] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 748.149999] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 748.150327] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 748.197559] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 748.197559] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 748.201107] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 748.208885] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 748.208885] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 748.208885] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 748.210260] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 748.210260] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 748.210513] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 748.210933] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 748.211134] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 748.211371] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 748.211587] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 748.211904] nova-scheduler[52181]: DEBUG nova.filters [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 748.212173] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 74.073884 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 748.212367] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 748.212565] nova-scheduler[52181]: INFO nova.filters [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filter ComputeFilter returned 0 hosts [ 748.215185] nova-scheduler[52181]: DEBUG nova.filters [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtering removed all hosts for the request with instance ID 'ca375850-3a4b-4c6f-8ec8-5708dc2f936e'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 748.215185] nova-scheduler[52181]: INFO nova.filters [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtering removed all hosts for the request with instance ID 'ca375850-3a4b-4c6f-8ec8-5708dc2f936e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 748.215185] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 748.215185] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2c29bfab-0ad7-4028-9256-a17fbe46754d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 750.262618] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Starting to schedule for instances: ['60441106-aaf9-49b2-b146-8b0c764b6016'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 750.262992] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 750.265513] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 750.265754] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 750.265993] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 750.266235] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 750.326829] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 750.327313] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 750.327480] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 750.335763] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 750.335763] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 750.336125] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 750.340789] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 750.340789] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 750.340918] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 750.341596] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 750.341596] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 750.341596] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 750.341930] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 750.341930] nova-scheduler[52185]: DEBUG nova.filters [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 750.342374] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 76.203805 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 750.342462] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 750.342623] nova-scheduler[52185]: INFO nova.filters [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Filter ComputeFilter returned 0 hosts [ 750.342771] nova-scheduler[52185]: DEBUG nova.filters [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Filtering removed all hosts for the request with instance ID '60441106-aaf9-49b2-b146-8b0c764b6016'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 750.342908] nova-scheduler[52185]: INFO nova.filters [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Filtering removed all hosts for the request with instance ID '60441106-aaf9-49b2-b146-8b0c764b6016'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 750.343081] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 750.343241] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-71f86aa9-a601-4d34-a118-3ef725cfd576 tempest-ServerAddressesNegativeTestJSON-1979938816 tempest-ServerAddressesNegativeTestJSON-1979938816-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 750.393414] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Starting to schedule for instances: ['58ac1c3e-2870-4504-a7b3-202406b6db02'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 750.395959] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 750.396349] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 750.396395] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 750.397221] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 750.397221] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 750.457917] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 750.458224] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 750.458377] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 750.467756] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 750.469957] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 750.469957] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 750.474838] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 750.474838] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 750.474982] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 750.475101] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 750.475101] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 750.475101] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 750.475247] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 750.475296] nova-scheduler[52181]: DEBUG nova.filters [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 750.475485] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 76.337242 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 750.475636] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 750.475823] nova-scheduler[52181]: INFO nova.filters [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Filter ComputeFilter returned 0 hosts [ 750.475972] nova-scheduler[52181]: DEBUG nova.filters [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Filtering removed all hosts for the request with instance ID '58ac1c3e-2870-4504-a7b3-202406b6db02'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 750.476118] nova-scheduler[52181]: INFO nova.filters [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Filtering removed all hosts for the request with instance ID '58ac1c3e-2870-4504-a7b3-202406b6db02'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 750.476260] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 750.476403] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4fc6927c-ab91-45c6-a7fe-53fd2a723ecb tempest-AttachInterfacesV270Test-1136141756 tempest-AttachInterfacesV270Test-1136141756-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 751.985524] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['280bde49-8fab-4fe2-8518-0bebad720479'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 751.985524] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 751.985524] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.985856] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.985856] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.985946] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 752.035685] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 752.036037] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 752.036226] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 752.043397] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 752.043818] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 752.044057] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 752.046760] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 752.047016] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 752.047419] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 752.047731] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 752.047917] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 752.048121] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 752.048357] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 752.048647] nova-scheduler[52185]: DEBUG nova.filters [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 752.048881] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 77.910613 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 752.049083] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 752.049273] nova-scheduler[52185]: INFO nova.filters [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 752.049450] nova-scheduler[52185]: DEBUG nova.filters [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '280bde49-8fab-4fe2-8518-0bebad720479'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 752.049608] nova-scheduler[52185]: INFO nova.filters [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '280bde49-8fab-4fe2-8518-0bebad720479'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 752.049799] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 752.049984] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-7a8d3501-e27a-4e8f-8173-e5852dfd56e5 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 755.837042] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['253188ab-2c7c-4839-8d87-817496e09cb0'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 755.837361] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 755.837517] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.837739] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.837966] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.839246] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 755.886221] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.886606] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.886694] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.894060] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.894267] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.894461] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.896487] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.896685] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.897128] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 755.897425] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 755.897598] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 755.897761] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 755.897937] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.898175] nova-scheduler[52181]: DEBUG nova.filters [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 755.898377] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 81.760132 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 755.898527] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 755.898674] nova-scheduler[52181]: INFO nova.filters [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 755.898825] nova-scheduler[52181]: DEBUG nova.filters [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '253188ab-2c7c-4839-8d87-817496e09cb0'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 755.898940] nova-scheduler[52181]: INFO nova.filters [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '253188ab-2c7c-4839-8d87-817496e09cb0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 755.899090] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 755.899270] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-2436e1d8-3ee8-43e9-8851-84bf114022c4 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 758.462074] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['23095fb2-cc38-4371-affc-e2613a934917'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 758.462074] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 758.462336] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 758.463931] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 758.463931] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 758.463931] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 758.508602] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 758.508991] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 758.508991] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 758.517061] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 758.517426] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 758.517426] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 758.520267] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 758.520267] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 758.520384] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 758.520461] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 758.520551] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 758.520864] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 758.520864] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 758.521105] nova-scheduler[52185]: DEBUG nova.filters [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 758.521300] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 84.383061 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 758.521442] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 758.521761] nova-scheduler[52185]: INFO nova.filters [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 758.521761] nova-scheduler[52185]: DEBUG nova.filters [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '23095fb2-cc38-4371-affc-e2613a934917'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 758.522393] nova-scheduler[52185]: INFO nova.filters [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '23095fb2-cc38-4371-affc-e2613a934917'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 758.522393] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 758.522393] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-a9c48531-e278-48c9-8fad-51746e5d234c tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 759.835626] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['9aed678d-de26-42bd-93df-996e1b4019eb'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 759.836261] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 759.836261] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 759.836345] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 759.836471] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 759.836719] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 759.890403] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 759.890403] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 759.890403] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 759.900787] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 759.900787] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 759.900787] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 759.902269] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 759.902553] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 759.904226] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 759.904414] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 759.904414] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 759.904414] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 759.904556] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 759.904556] nova-scheduler[52181]: DEBUG nova.filters [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 759.904556] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 85.765772 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 759.904556] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 759.904556] nova-scheduler[52181]: INFO nova.filters [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 759.904719] nova-scheduler[52181]: DEBUG nova.filters [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '9aed678d-de26-42bd-93df-996e1b4019eb'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 759.904719] nova-scheduler[52181]: INFO nova.filters [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '9aed678d-de26-42bd-93df-996e1b4019eb'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 759.904719] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 759.905114] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-4e57a8f4-5cdf-46a1-b896-5e61790d0e8e tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 761.080276] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Starting to schedule for instances: ['1ec2719e-2473-477a-92d7-8fba75e97684'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 761.080607] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 761.080790] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.080971] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.081194] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.081376] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 761.146808] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.147041] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.147201] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.156734] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.156937] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.157113] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.161241] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.161445] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.161826] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 761.162139] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 761.162303] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 761.162448] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 761.162604] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.162868] nova-scheduler[52185]: DEBUG nova.filters [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 761.163162] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 87.024838 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 761.163330] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 761.163479] nova-scheduler[52185]: INFO nova.filters [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filter ComputeFilter returned 0 hosts [ 761.163622] nova-scheduler[52185]: DEBUG nova.filters [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtering removed all hosts for the request with instance ID '1ec2719e-2473-477a-92d7-8fba75e97684'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 761.163768] nova-scheduler[52185]: INFO nova.filters [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtering removed all hosts for the request with instance ID '1ec2719e-2473-477a-92d7-8fba75e97684'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 761.163913] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 761.164547] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-dfd26c06-0139-4761-950c-d6d02e06649d tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 762.252125] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['a5f4fbea-948f-4e98-8e5f-7348eb6c652b'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 762.252606] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 762.252606] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.252781] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.252936] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.254739] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 762.295860] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.296585] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.296990] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.305121] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.305216] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.305434] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.308082] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.308543] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.309275] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 762.309814] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 762.309989] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 762.310260] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 762.311050] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.311642] nova-scheduler[52181]: DEBUG nova.filters [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 762.312033] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 88.173558 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 762.312272] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 762.312588] nova-scheduler[52181]: INFO nova.filters [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 762.312695] nova-scheduler[52181]: DEBUG nova.filters [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID 'a5f4fbea-948f-4e98-8e5f-7348eb6c652b'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 762.312887] nova-scheduler[52181]: INFO nova.filters [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID 'a5f4fbea-948f-4e98-8e5f-7348eb6c652b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 762.313137] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 762.313351] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-3cd78985-4d5b-4a75-a66e-1e92a364fe06 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 762.412868] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['2a5a318e-8a19-4375-ade9-e019cd04cae8'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 762.413193] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 762.413916] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.414078] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.414330] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.415251] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 762.466183] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.466386] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.466477] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.474820] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.475076] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.475245] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.477459] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.477581] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.477902] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 762.479384] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 762.479384] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 762.479384] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 762.479912] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.479912] nova-scheduler[52185]: DEBUG nova.filters [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 762.479912] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 88.340859 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 762.479912] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 762.479912] nova-scheduler[52185]: INFO nova.filters [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 762.480093] nova-scheduler[52185]: DEBUG nova.filters [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '2a5a318e-8a19-4375-ade9-e019cd04cae8'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 762.480093] nova-scheduler[52185]: INFO nova.filters [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '2a5a318e-8a19-4375-ade9-e019cd04cae8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 762.480093] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 762.480093] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-281992fb-2f1b-4d61-a17f-6209f4299e8d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 762.620515] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Starting to schedule for instances: ['ab7961b6-8449-4b66-83d4-e251b3305a36'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 762.620833] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 762.620993] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.621383] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.621611] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.621755] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 762.677138] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.677380] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.677538] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.690634] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.690870] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.690999] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.699708] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.700076] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.700603] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 762.700730] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 762.700889] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 762.701057] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 762.701224] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.701487] nova-scheduler[52181]: DEBUG nova.filters [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 762.701487] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 88.563449 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 762.701487] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 762.701487] nova-scheduler[52181]: INFO nova.filters [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Filter ComputeFilter returned 0 hosts [ 762.701487] nova-scheduler[52181]: DEBUG nova.filters [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Filtering removed all hosts for the request with instance ID 'ab7961b6-8449-4b66-83d4-e251b3305a36'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 762.704412] nova-scheduler[52181]: INFO nova.filters [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Filtering removed all hosts for the request with instance ID 'ab7961b6-8449-4b66-83d4-e251b3305a36'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 762.704412] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 762.704412] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-73eb36a3-a5a6-483c-be1a-5d5186fff2c3 tempest-ServerShowV257Test-1850003832 tempest-ServerShowV257Test-1850003832-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 763.678636] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['64ef20cf-5e57-4c41-bca1-7f68ed15e0ed'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 763.678967] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 763.680481] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.680739] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.680988] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.681191] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 763.735342] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.735560] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.735730] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.746142] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.746356] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.746518] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.750566] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.750825] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.751267] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 763.751551] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 763.751731] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 763.751884] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 763.752056] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.752312] nova-scheduler[52185]: DEBUG nova.filters [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 763.752518] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 89.614273 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 763.752669] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 763.752819] nova-scheduler[52185]: INFO nova.filters [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 763.752964] nova-scheduler[52185]: DEBUG nova.filters [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '64ef20cf-5e57-4c41-bca1-7f68ed15e0ed'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 763.753109] nova-scheduler[52185]: INFO nova.filters [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '64ef20cf-5e57-4c41-bca1-7f68ed15e0ed'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 763.753252] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 763.753390] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-5350268e-1579-461b-8475-8ac7b486df97 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 764.094186] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Starting to schedule for instances: ['ceee2fd6-7005-45ec-93e1-385543fbe412'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 764.095250] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 764.095250] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.095250] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.095454] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.095560] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 764.145110] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.145110] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.145110] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.157874] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.158111] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.159034] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.161102] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.161309] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.161799] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 764.162097] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 764.162268] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 764.162715] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 764.162916] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.163479] nova-scheduler[52181]: DEBUG nova.filters [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 764.163694] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 90.025437 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 764.163853] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 764.164011] nova-scheduler[52181]: INFO nova.filters [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Filter ComputeFilter returned 0 hosts [ 764.164481] nova-scheduler[52181]: DEBUG nova.filters [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Filtering removed all hosts for the request with instance ID 'ceee2fd6-7005-45ec-93e1-385543fbe412'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 764.164666] nova-scheduler[52181]: INFO nova.filters [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Filtering removed all hosts for the request with instance ID 'ceee2fd6-7005-45ec-93e1-385543fbe412'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 764.164821] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 764.164971] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-8c33cade-6f97-4f98-a179-6e420019afe0 tempest-ServerAddressesTestJSON-1896814982 tempest-ServerAddressesTestJSON-1896814982-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 766.065885] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['70bfc91c-9519-4b81-907d-d6e0da0b7e88'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 766.066502] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 766.066581] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.066783] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.067022] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.067204] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 766.130055] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.130055] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.130055] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.136376] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.136376] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.136504] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.138844] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.138844] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.139806] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 766.139982] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 766.139982] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 766.139982] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 766.140209] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.140209] nova-scheduler[52185]: DEBUG nova.filters [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 766.140405] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 92.002157 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 766.140546] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 766.140860] nova-scheduler[52185]: INFO nova.filters [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 766.140860] nova-scheduler[52185]: DEBUG nova.filters [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '70bfc91c-9519-4b81-907d-d6e0da0b7e88'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 766.140981] nova-scheduler[52185]: INFO nova.filters [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '70bfc91c-9519-4b81-907d-d6e0da0b7e88'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 766.141105] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 766.141265] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-5196af9e-1820-4180-85e0-ce9a205da864 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 766.754145] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Starting to schedule for instances: ['fe60d841-5406-4501-beb6-0c9dadd78edc'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 766.754447] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 766.754605] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.754781] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.754988] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.755531] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 766.803913] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.804160] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.804326] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.811505] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.811784] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.811956] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.814190] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.814391] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.814765] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 766.815089] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 766.815261] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 766.815417] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 766.815576] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.815832] nova-scheduler[52181]: DEBUG nova.filters [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 766.816225] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 92.677791 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 766.816225] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 766.816378] nova-scheduler[52181]: INFO nova.filters [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filter ComputeFilter returned 0 hosts [ 766.816554] nova-scheduler[52181]: DEBUG nova.filters [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtering removed all hosts for the request with instance ID 'fe60d841-5406-4501-beb6-0c9dadd78edc'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 766.816708] nova-scheduler[52181]: INFO nova.filters [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtering removed all hosts for the request with instance ID 'fe60d841-5406-4501-beb6-0c9dadd78edc'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 766.816859] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 766.817056] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-a38fa1a7-3f6a-495e-9b81-945afebf86da tempest-AttachVolumeNegativeTest-541211137 tempest-AttachVolumeNegativeTest-541211137-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.647974] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['4c956deb-b893-4e03-a289-6b138e0310e6'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.648267] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.648424] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.648596] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.648783] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.649013] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.692873] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.693112] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.693276] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.699825] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.700094] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.700272] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.702241] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.702407] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.702766] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.703122] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.703358] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.703504] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.703615] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.703864] nova-scheduler[52185]: DEBUG nova.filters [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.704075] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 93.565822 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.704228] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 767.704372] nova-scheduler[52185]: INFO nova.filters [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 767.704511] nova-scheduler[52185]: DEBUG nova.filters [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '4c956deb-b893-4e03-a289-6b138e0310e6'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.704639] nova-scheduler[52185]: INFO nova.filters [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '4c956deb-b893-4e03-a289-6b138e0310e6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.704803] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.704944] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-fc7b48cc-d199-4d94-9dd1-fb684a84b733 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.834964] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Starting to schedule for instances: ['d53a7c81-c6b6-4a2a-a2f6-e9f659cb9f77'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.835456] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.835620] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.835828] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.836046] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.836233] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.889948] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.890206] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.890408] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.897109] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.897318] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.897473] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.900363] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.900561] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.901501] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.901639] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.901639] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.901639] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.901782] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.901986] nova-scheduler[52181]: DEBUG nova.filters [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.902307] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 93.763966 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.902528] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 767.902702] nova-scheduler[52181]: INFO nova.filters [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Filter ComputeFilter returned 0 hosts [ 767.902854] nova-scheduler[52181]: DEBUG nova.filters [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Filtering removed all hosts for the request with instance ID 'd53a7c81-c6b6-4a2a-a2f6-e9f659cb9f77'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.902993] nova-scheduler[52181]: INFO nova.filters [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Filtering removed all hosts for the request with instance ID 'd53a7c81-c6b6-4a2a-a2f6-e9f659cb9f77'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.903193] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.903357] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-3925fb09-acf4-4b01-8efa-0b7899f4ec9c tempest-ServerGroupTestJSON-1551242793 tempest-ServerGroupTestJSON-1551242793-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 769.038672] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting to schedule for instances: ['11e66c18-f38b-472e-bd0d-9889280f59bf'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 769.038975] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 769.041893] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.043434] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.043680] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.043875] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 769.112280] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.116146] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.116146] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.124326] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.125762] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.125762] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.127318] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.127532] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.127929] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 769.128378] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 769.128573] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 769.128720] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 769.128885] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.129195] nova-scheduler[52185]: DEBUG nova.filters [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 769.129414] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 94.991156 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 769.129573] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 769.129906] nova-scheduler[52185]: INFO nova.filters [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filter ComputeFilter returned 0 hosts [ 769.129906] nova-scheduler[52185]: DEBUG nova.filters [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '11e66c18-f38b-472e-bd0d-9889280f59bf'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 769.130224] nova-scheduler[52185]: INFO nova.filters [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtering removed all hosts for the request with instance ID '11e66c18-f38b-472e-bd0d-9889280f59bf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 769.130453] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 769.130584] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-20927d0b-d36f-48b8-bc09-6941cea3b578 tempest-DeleteServersTestJSON-1725733590 tempest-DeleteServersTestJSON-1725733590-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.069342] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['73e31978-4d20-421d-8fe6-e33e966f764f'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.069967] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.069967] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.070105] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.071217] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.071217] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.121658] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.121939] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.122179] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.129891] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.130137] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.130413] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.132600] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.132753] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.133122] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.133402] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.133579] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.133739] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.133878] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.134184] nova-scheduler[52181]: DEBUG nova.filters [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.134346] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 95.996096 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.134495] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 770.135056] nova-scheduler[52181]: INFO nova.filters [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 770.135248] nova-scheduler[52181]: DEBUG nova.filters [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '73e31978-4d20-421d-8fe6-e33e966f764f'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.135534] nova-scheduler[52181]: INFO nova.filters [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID '73e31978-4d20-421d-8fe6-e33e966f764f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.135685] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.135825] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-9bbdb590-90eb-4117-b1c0-975f69847a98 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 771.464199] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Starting to schedule for instances: ['9094c607-f110-4533-9e24-f9dc25f557d1'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 771.464460] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 771.464460] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 771.464581] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 771.464774] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 771.464975] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 771.521342] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 771.521968] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 771.522286] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 771.529735] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 771.530117] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 771.530277] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 771.532526] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 771.532779] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 771.533217] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 771.533658] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 771.534143] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 771.534412] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 771.534638] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 771.534956] nova-scheduler[52185]: DEBUG nova.filters [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 771.539021] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 97.396946 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 771.539021] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 771.539021] nova-scheduler[52185]: INFO nova.filters [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filter ComputeFilter returned 0 hosts [ 771.539021] nova-scheduler[52185]: DEBUG nova.filters [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filtering removed all hosts for the request with instance ID '9094c607-f110-4533-9e24-f9dc25f557d1'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 771.539021] nova-scheduler[52185]: INFO nova.filters [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filtering removed all hosts for the request with instance ID '9094c607-f110-4533-9e24-f9dc25f557d1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 771.539619] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 771.539619] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-4914aedf-0759-4d4d-add3-0c3af8ea2660 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 772.611300] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['ab4c5ea3-d41b-4080-bba7-b092e8123c17'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 772.611300] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 772.611300] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.611300] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.611300] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.612690] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 772.657214] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.657463] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.657627] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.666445] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.666693] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.666863] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.669175] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.669376] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.669988] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 772.670294] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 772.670755] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 772.670956] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 772.671157] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.671440] nova-scheduler[52181]: DEBUG nova.filters [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 772.671650] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 98.5334 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 772.671805] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 772.671958] nova-scheduler[52181]: INFO nova.filters [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 772.672366] nova-scheduler[52181]: DEBUG nova.filters [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID 'ab4c5ea3-d41b-4080-bba7-b092e8123c17'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 772.672524] nova-scheduler[52181]: INFO nova.filters [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID 'ab4c5ea3-d41b-4080-bba7-b092e8123c17'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 772.672696] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 772.673440] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-99e8ba86-514b-422b-9a56-17b4b42d559d tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 772.830192] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Starting to schedule for instances: ['4c0362e0-8c9c-4b06-8bae-0660557858b2'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 772.830192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 772.830192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.830192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.830192] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.830519] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 772.875607] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.877037] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.877037] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.888381] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.888381] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.888381] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.888381] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.888740] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.888795] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 772.889112] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 772.889316] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 772.889810] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 772.889810] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.891885] nova-scheduler[52185]: DEBUG nova.filters [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 772.891885] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 98.751989 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 772.891885] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 772.891885] nova-scheduler[52185]: INFO nova.filters [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Filter ComputeFilter returned 0 hosts [ 772.891885] nova-scheduler[52185]: DEBUG nova.filters [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Filtering removed all hosts for the request with instance ID '4c0362e0-8c9c-4b06-8bae-0660557858b2'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 772.892129] nova-scheduler[52185]: INFO nova.filters [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Filtering removed all hosts for the request with instance ID '4c0362e0-8c9c-4b06-8bae-0660557858b2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 772.892129] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 772.892129] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-6518154c-fa6e-4279-809f-f2365f473454 tempest-ServersTestManualDisk-1383397774 tempest-ServersTestManualDisk-1383397774-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 775.092444] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting to schedule for instances: ['e0bb4fa8-2bc1-45b6-a591-e2436dbe794a'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 775.092745] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 775.092901] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.093087] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.093281] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.093454] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 775.149164] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.149397] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.149583] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.161201] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.161423] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.161587] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.164540] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.164540] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.164680] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 775.164763] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 775.164872] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 775.165041] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 775.165224] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.165535] nova-scheduler[52181]: DEBUG nova.filters [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 775.165754] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 101.027497 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 775.165968] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 775.166192] nova-scheduler[52181]: INFO nova.filters [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filter ComputeFilter returned 0 hosts [ 775.166371] nova-scheduler[52181]: DEBUG nova.filters [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID 'e0bb4fa8-2bc1-45b6-a591-e2436dbe794a'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 775.166538] nova-scheduler[52181]: INFO nova.filters [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtering removed all hosts for the request with instance ID 'e0bb4fa8-2bc1-45b6-a591-e2436dbe794a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 775.166698] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 775.166896] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-01e43b73-69ac-4666-8f01-099eb61916c5 tempest-ServersTestJSON-314879797 tempest-ServersTestJSON-314879797-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 775.882194] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Starting to schedule for instances: ['237850de-f7f7-49cf-97dd-5dfac741a3a1'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 775.882497] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 775.882632] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.882807] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.883109] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.883343] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 775.933975] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.934879] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.935236] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.944804] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.945339] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.945579] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.948343] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.948756] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.949230] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 775.949582] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 775.949808] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 775.951317] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 775.951317] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.951317] nova-scheduler[52185]: DEBUG nova.filters [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 775.951317] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 101.812658 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 775.951692] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 775.951692] nova-scheduler[52185]: INFO nova.filters [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filter ComputeFilter returned 0 hosts [ 775.951692] nova-scheduler[52185]: DEBUG nova.filters [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filtering removed all hosts for the request with instance ID '237850de-f7f7-49cf-97dd-5dfac741a3a1'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 775.951853] nova-scheduler[52185]: INFO nova.filters [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filtering removed all hosts for the request with instance ID '237850de-f7f7-49cf-97dd-5dfac741a3a1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 775.951893] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 775.952316] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-816db4c7-c060-4ede-8885-4cd878a9d8c7 tempest-AttachVolumeShelveTestJSON-473055563 tempest-AttachVolumeShelveTestJSON-473055563-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 776.522598] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Starting to schedule for instances: ['11894f7f-d67d-4356-80ad-bb7c16464e12'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 776.522898] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 776.523320] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.524047] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.524047] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.524047] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 776.567779] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.568020] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.568218] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.574556] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.574816] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.574927] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.576880] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.577098] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.577493] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='34',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='1',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:05:42Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=4) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 776.577909] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 776.578122] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 776.578308] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Update host state with instances: ['68545276-63f2-4baf-8110-d3cc71686682', 'b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 776.578471] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.578721] nova-scheduler[52181]: DEBUG nova.filters [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 776.578993] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 102.440681 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 776.579269] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 776.579474] nova-scheduler[52181]: INFO nova.filters [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Filter ComputeFilter returned 0 hosts [ 776.579632] nova-scheduler[52181]: DEBUG nova.filters [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Filtering removed all hosts for the request with instance ID '11894f7f-d67d-4356-80ad-bb7c16464e12'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 776.579795] nova-scheduler[52181]: INFO nova.filters [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Filtering removed all hosts for the request with instance ID '11894f7f-d67d-4356-80ad-bb7c16464e12'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 776.579960] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 776.580099] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-f8f32154-6518-492b-ac13-eb50db110a79 tempest-ServerTagsTestJSON-1052921131 tempest-ServerTagsTestJSON-1052921131-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 783.462153] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Starting to schedule for instances: ['7ce56d80-2e8f-4648-996a-045c20662dfd'] {{(pid=52185) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 783.462153] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52185) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 783.462153] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.462153] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.462510] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52185) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.462510] nova-scheduler[52185]: DEBUG nova.scheduler.request_filter [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] ephemeral_encryption_filter skipped {{(pid=52185) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 783.505463] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.506364] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.506364] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.512946] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.513059] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.513215] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.515405] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.515613] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.516025] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='35',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='0',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='2',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:06:12Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=3) {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 783.517213] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Update host state with aggregates: [] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 783.517213] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 783.517213] nova-scheduler[52185]: DEBUG nova.scheduler.host_manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Update host state with instances: ['b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52185) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 783.517445] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.517445] nova-scheduler[52185]: DEBUG nova.filters [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Starting with 1 host(s) {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 783.517445] nova-scheduler[52185]: DEBUG nova.servicegroup.drivers.db [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 109.379009 {{(pid=52185) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 783.517445] nova-scheduler[52185]: WARNING nova.scheduler.filters.compute_filter [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 783.517610] nova-scheduler[52185]: INFO nova.filters [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Filter ComputeFilter returned 0 hosts [ 783.517710] nova-scheduler[52185]: DEBUG nova.filters [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Filtering removed all hosts for the request with instance ID '7ce56d80-2e8f-4648-996a-045c20662dfd'. Filter results: [('ComputeFilter', None)] {{(pid=52185) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 783.518328] nova-scheduler[52185]: INFO nova.filters [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Filtering removed all hosts for the request with instance ID '7ce56d80-2e8f-4648-996a-045c20662dfd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 783.518328] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] Filtered [] {{(pid=52185) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 783.518328] nova-scheduler[52185]: DEBUG nova.scheduler.manager [None req-7da7e836-3756-4583-a8b7-85eefbba1138 tempest-InstanceActionsNegativeTestJSON-702990142 tempest-InstanceActionsNegativeTestJSON-702990142-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52185) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 784.209585] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Starting to schedule for instances: ['02b4c855-59ee-4e04-b583-73ee090610ba'] {{(pid=52181) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 784.210022] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52181) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 784.210093] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.210275] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.210464] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52181) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.210675] nova-scheduler[52181]: DEBUG nova.scheduler.request_filter [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] ephemeral_encryption_filter skipped {{(pid=52181) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 784.250906] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.251201] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.251387] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.260366] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.260611] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.260780] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.262952] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.263166] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.263536] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-15T19:02:24Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='35',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_0be6718d0cbe4351a06b59576311c7f8='0',num_proj_2d138ee86d5a4657a3c40323d42a362b='0',num_proj_33b22598eb074c35b7782df547b1cdea='0',num_proj_39d93795676543a287744d7fde7dde5c='0',num_proj_65241354dfa84a61977e9f11a0483dc9='0',num_proj_a0e821828b384a40a78522e538c9dcdf='1',num_proj_a98b1fd8031545e381db0682e508fc18='0',num_proj_af6d8fe22e704a3aa476242b6f6ef896='1',num_proj_b00aed0dfc1040dab445131a92d0ef27='0',num_proj_bd9480d686364ebab0d87bd617f302fa='0',num_proj_cc5a77f597ba4db3a043b8962c824544='1',num_proj_e05387f01e784108985ef588ab2b8094='0',num_task_None='1',num_task_spawning='2',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-15T19:06:12Z,uuid=ab7eee2c-d48f-4d45-b0c7-727ddc03ea4f,vcpus=48,vcpus_used=3) {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 784.263816] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Update host state with aggregates: [] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 784.263988] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Update host state with service dict: {'id': 6, 'uuid': '7fecf517-16d3-4ba8-97c9-61ae09960ea2', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 15, 19, 2, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 15, 19, 4, 29, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 784.264169] nova-scheduler[52181]: DEBUG nova.scheduler.host_manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Update host state with instances: ['b1361aa5-9bbd-4891-b74f-a0afd90b0bd6', '6c8194c3-68fd-4ffc-a0fa-f23c8935bee6', '946c73f8-1ed8-4180-a9d7-0b2970c4367e'] {{(pid=52181) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 784.264320] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.264579] nova-scheduler[52181]: DEBUG nova.filters [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Starting with 1 host(s) {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 784.264786] nova-scheduler[52181]: DEBUG nova.servicegroup.drivers.db [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-15 19:04:29. Elapsed time is 110.126535 {{(pid=52181) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 784.264953] nova-scheduler[52181]: WARNING nova.scheduler.filters.compute_filter [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 784.265128] nova-scheduler[52181]: INFO nova.filters [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Filter ComputeFilter returned 0 hosts [ 784.265273] nova-scheduler[52181]: DEBUG nova.filters [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Filtering removed all hosts for the request with instance ID '02b4c855-59ee-4e04-b583-73ee090610ba'. Filter results: [('ComputeFilter', None)] {{(pid=52181) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 784.265407] nova-scheduler[52181]: INFO nova.filters [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Filtering removed all hosts for the request with instance ID '02b4c855-59ee-4e04-b583-73ee090610ba'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 784.265552] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] Filtered [] {{(pid=52181) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 784.265694] nova-scheduler[52181]: DEBUG nova.scheduler.manager [None req-673da9f5-bb6f-4835-a532-6b46027168e3 tempest-ServerActionsV293TestJSON-2138665278 tempest-ServerActionsV293TestJSON-2138665278-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52181) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 789.898399] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.898697] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.898697] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.898927] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.898986] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.899062] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.899121] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.899277] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.899527] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.899704] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.902300] nova-scheduler[52185]: INFO nova.scheduler.host_manager [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 789.902475] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.902946] nova-scheduler[52181]: INFO nova.scheduler.host_manager [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 789.903140] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-842f33cf-b2b1-4148-b642-a3fc9a885bc5 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 909.896547] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 909.896825] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 909.896989] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 909.897061] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 909.897117] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 909.897275] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Acquiring lock "b5105805-148c-4545-8985-397f7b32e247" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 909.897343] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 909.897453] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 909.897495] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 909.897610] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "b5105805-148c-4545-8985-397f7b32e247" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 909.900398] nova-scheduler[52185]: INFO nova.scheduler.host_manager [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 909.900539] nova-scheduler[52181]: INFO nova.scheduler.host_manager [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 909.900582] nova-scheduler[52185]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52185) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 909.900760] nova-scheduler[52181]: DEBUG oslo_concurrency.lockutils [None req-8272f68d-41fc-4e36-9642-c7efb2dcfb02 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52181) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}