[ 447.660848] nova-scheduler[51345]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 448.708644] nova-scheduler[51345]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 448.718737] nova-scheduler[51345]: DEBUG oslo_db.sqlalchemy.engines [None req-6a72c956-9ba2-4afc-a720-2e4e86bc20b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 448.822129] nova-scheduler[51345]: DEBUG nova.scheduler.host_manager [None req-6a72c956-9ba2-4afc-a720-2e4e86bc20b4 None None] Found 1 cells: b8904d0d-fa99-4946-a73d-f3e2509db3c8 {{(pid=51345) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 448.822277] nova-scheduler[51345]: DEBUG nova.scheduler.host_manager [None req-6a72c956-9ba2-4afc-a720-2e4e86bc20b4 None None] Found 0 disabled cells: {{(pid=51345) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 448.851305] nova-scheduler[51345]: DEBUG nova.scheduler.host_manager [None req-6a72c956-9ba2-4afc-a720-2e4e86bc20b4 None None] START:_async_init_instance_info {{(pid=51345) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 448.853403] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 448.853606] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 448.854860] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 448.860204] nova-scheduler[51345]: DEBUG oslo_db.sqlalchemy.engines [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 448.867987] nova-scheduler[51345]: DEBUG nova.scheduler.host_manager [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Total number of compute nodes: 0 {{(pid=51345) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 448.868353] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 448.868547] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 448.868703] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 448.921971] nova-scheduler[51345]: DEBUG nova.scheduler.host_manager [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] Adding 0 instances for hosts 10-20 {{(pid=51345) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 448.924504] nova-scheduler[51345]: DEBUG nova.scheduler.host_manager [None req-5ee42695-cb70-426c-8ed5-bb15021a557d None None] END:_async_init_instance_info {{(pid=51345) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 448.940207] nova-scheduler[51345]: DEBUG nova.context [None req-6a72c956-9ba2-4afc-a720-2e4e86bc20b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8904d0d-fa99-4946-a73d-f3e2509db3c8(cell1) {{(pid=51345) load_cells /opt/stack/nova/nova/context.py:464}} [ 448.940670] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 448.940876] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 448.941520] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 448.941847] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 448.942027] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 448.942180] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 448.949350] nova-scheduler[51345]: DEBUG oslo_db.sqlalchemy.engines [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 448.955010] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Acquiring lock "singleton_lock" {{(pid=51345) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 448.955180] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Acquired lock "singleton_lock" {{(pid=51345) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 448.955413] nova-scheduler[51345]: DEBUG oslo_concurrency.lockutils [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Releasing lock "singleton_lock" {{(pid=51345) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 448.955624] nova-scheduler[51345]: INFO oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Starting 2 workers [ 448.960273] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Started child 52224 {{(pid=51345) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 448.963748] nova-scheduler[52224]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 448.964672] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Started child 52226 {{(pid=51345) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 448.965267] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Full set of CONF: {{(pid=51345) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 448.965458] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ******************************************************************************** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 448.965596] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] Configuration options gathered from: {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 448.965752] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 448.966084] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] config files: ['/etc/nova/nova.conf'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 448.966210] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ================================================================================ {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 448.966729] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] allow_resize_to_same_host = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.966952] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] arq_binding_timeout = 300 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.967137] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] block_device_allocate_retries = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.967324] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] block_device_allocate_retries_interval = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.967540] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cert = self.pem {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.967640] nova-scheduler[52226]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 448.967839] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute_driver = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.967939] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute_monitors = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.968177] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] config_dir = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.968392] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] config_drive_format = iso9660 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.968528] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.968710] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] config_source = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.968881] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] console_host = devstack {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.969063] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] control_exchange = nova {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.969246] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cpu_allocation_ratio = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.969434] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] daemon = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.969634] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] debug = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.969803] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] default_access_ip_network_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.969992] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] default_availability_zone = nova {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.970139] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] default_ephemeral_format = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.970435] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.970624] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] default_schedule_zone = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.970797] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] disk_allocation_ratio = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.970969] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] enable_new_services = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.971194] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] enabled_apis = ['osapi_compute'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.971382] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] enabled_ssl_apis = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.971572] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] flat_injected = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.971729] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] force_config_drive = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.971897] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] force_raw_images = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.972088] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] graceful_shutdown_timeout = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.972250] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] heal_instance_info_cache_interval = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.972699] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] host = devstack {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.972904] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.973083] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] initial_disk_allocation_ratio = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.973240] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] initial_ram_allocation_ratio = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.973506] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.973677] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_build_timeout = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.973845] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_delete_interval = 300 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.974003] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_format = [instance: %(uuid)s] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.974161] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_name_template = instance-%08x {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.974316] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_usage_audit = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.974518] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_usage_audit_period = month {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.974701] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.974878] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] instances_path = /opt/stack/data/nova/instances {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.975041] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] internal_service_availability_zone = internal {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.975192] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] key = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.975365] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] live_migration_retry_count = 30 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.975556] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_config_append = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.975731] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.975885] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_dir = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976048] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976168] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_options = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976328] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_rotate_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976524] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_rotate_interval_type = days {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976718] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] log_rotation_type = none {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976844] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.976966] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.977131] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.977306] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.977443] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.977627] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] long_rpc_timeout = 1800 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.977783] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] max_concurrent_builds = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.977934] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] max_concurrent_live_migrations = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] max_concurrent_snapshots = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] max_local_block_devices = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] max_logfile_count = 30 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] max_logfile_size_mb = 200 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] maximum_instance_delete_attempts = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metadata_listen = 0.0.0.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.979810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metadata_listen_port = 8775 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980053] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metadata_workers = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980053] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] migrate_max_retries = -1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980053] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] mkisofs_cmd = genisoimage {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980130] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] my_block_storage_ip = 10.180.1.21 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980225] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] my_ip = 10.180.1.21 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980360] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] network_allocate_retries = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980565] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980725] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] osapi_compute_listen = 0.0.0.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.980897] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] osapi_compute_listen_port = 8774 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.981006] nova-scheduler[52226]: DEBUG oslo_db.sqlalchemy.engines [None req-ddb63b4d-df76-4dae-b7f1-7dce4b0a39df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52226) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 448.981053] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] osapi_compute_unique_server_name_scope = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.981236] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] osapi_compute_workers = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.981395] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] password_length = 12 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.981550] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] periodic_enable = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.981729] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] periodic_fuzzy_delay = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.981913] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] pointer_model = usbtablet {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982097] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] preallocate_images = none {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982252] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] publish_errors = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982372] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] pybasedir = /opt/stack/nova {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982520] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ram_allocation_ratio = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982665] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rate_limit_burst = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982823] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rate_limit_except_level = CRITICAL {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.982920] nova-scheduler[52224]: DEBUG oslo_db.sqlalchemy.engines [None req-82617efc-7d8e-435e-b269-9cda79a60e4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52224) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 448.982989] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rate_limit_interval = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.983139] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reboot_timeout = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.983287] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reclaim_instance_interval = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.983429] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] record = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.983593] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reimage_timeout_per_gb = 20 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.983756] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] report_interval = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.983911] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rescue_timeout = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.984067] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reserved_host_cpus = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.984215] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reserved_host_disk_mb = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.984371] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reserved_host_memory_mb = 512 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.984546] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] reserved_huge_pages = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.984698] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] resize_confirm_window = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.984865] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] resize_fs_using_block_device = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985258] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] resume_guests_state_on_host_boot = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985258] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985323] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] run_external_periodic_tasks = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985494] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] running_deleted_instance_action = reap {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985665] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] running_deleted_instance_poll_interval = 1800 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985823] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] running_deleted_instance_timeout = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.985989] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler_instance_sync_interval = 120 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.986137] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_down_time = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.986314] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] servicegroup_driver = db {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.986460] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] shelved_offload_time = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.986607] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] shelved_poll_interval = 3600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.986781] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] shutdown_timeout = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.986954] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] source_is_ipv6 = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.987101] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ssl_only = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.987279] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] state_path = /opt/stack/data/nova {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.987433] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] sync_power_state_interval = 600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.987576] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] sync_power_state_pool_size = 1000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.987997] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] syslog_log_facility = LOG_USER {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.987997] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] tempdir = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988086] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] timeout_nbd = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988217] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] transport_url = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988367] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] update_resources_interval = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988512] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_cow_images = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988657] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_eventlog = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988799] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_journal = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.988972] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_json = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.989118] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_rootwrap_daemon = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.989266] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_stderr = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.989455] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] use_syslog = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.989624] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vcpu_pin_set = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.989784] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vif_plugging_is_fatal = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.990129] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vif_plugging_timeout = 300 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.990129] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] virt_mkfs = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.990306] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] volume_usage_poll_interval = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.990470] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] watch_log_file = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.990650] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] web = /usr/share/spice-html5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 448.990925] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_concurrency.disable_process_locking = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.991131] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.991357] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.auth_strategy = keystone {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.991538] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.compute_link_prefix = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.991759] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.991946] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.dhcp_domain = novalocal {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.992136] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.enable_instance_password = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.992313] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.glance_link_prefix = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.992739] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.992739] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.992811] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.instance_list_per_project_cells = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.992971] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.list_records_by_skipping_down_cells = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.993141] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.local_metadata_per_cell = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.993333] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.max_limit = 1000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.993499] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.metadata_cache_expiration = 15 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.993663] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.neutron_default_tenant_id = default {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.993823] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.use_forwarded_for = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.993981] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.use_neutron_default_nets = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.994140] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.994293] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.994451] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.994616] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.994786] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_dynamic_targets = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.994937] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_jsonfile_path = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.995099] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.995718] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.backend = dogpile.cache.memcached {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.995718] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.backend_argument = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.995718] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.config_prefix = cache.oslo {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.995880] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.dead_timeout = 60.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.996067] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.debug_cache_backend = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.996248] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.enable_retry_client = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.996423] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.enable_socket_keepalive = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.996585] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.enabled = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.996756] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.expiration_time = 600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.996913] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.hashclient_retry_attempts = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.997068] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.hashclient_retry_delay = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.997240] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_dead_retry = 300 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.997399] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_password = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.997574] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.997740] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.997891] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_pool_maxsize = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.998058] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.998213] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_sasl_enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.998377] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.998547] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_socket_timeout = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.998703] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.memcache_username = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.998877] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.proxies = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999032] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.retry_attempts = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999183] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.retry_delay = 0.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999358] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.socket_keepalive_count = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999519] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.socket_keepalive_idle = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999668] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.socket_keepalive_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999814] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.tls_allowed_ciphers = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 448.999963] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.tls_cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.000122] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.tls_certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.000272] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.tls_enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.000415] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cache.tls_keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.000632] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.000802] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.auth_type = password {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.000951] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.001143] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.catalog_info = volumev3::publicURL {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.001308] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.001464] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.001652] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.cross_az_attach = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.001823] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.debug = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.001975] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.endpoint_template = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.002150] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.http_retries = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.002314] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.002467] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.002645] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.os_region_name = RegionOne {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.002799] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.002948] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cinder.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.003113] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.003282] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.cpu_dedicated_set = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.003431] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.cpu_shared_set = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.003586] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.image_type_exclude_list = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.003755] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.003908] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.max_concurrent_disk_ops = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.004113] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.max_disk_devices_to_attach = -1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.004222] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.004379] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.004536] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.resource_provider_association_refresh = 300 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.004685] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.shutdown_retry_interval = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.004862] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005047] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] conductor.workers = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005212] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] console.allowed_origins = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005376] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] console.ssl_ciphers = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005540] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] console.ssl_minimum_version = default {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005704] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] consoleauth.token_ttl = 600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005890] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.005944] nova-scheduler[52226]: DEBUG nova.service [None req-ddb63b4d-df76-4dae-b7f1-7dce4b0a39df None None] Creating RPC server for service scheduler {{(pid=52226) start /opt/stack/nova/nova/service.py:182}} [ 449.006038] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.006193] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.006345] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.006498] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.006642] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.006792] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.006933] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.007107] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.007262] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.007402] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.region_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.007546] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.007734] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.service_type = accelerator {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.007874] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.008039] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.008187] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.008347] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.008516] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.008987] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] cyborg.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.008987] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.backend = sqlalchemy {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009052] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.connection = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009171] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.connection_debug = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009355] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.connection_parameters = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009522] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.connection_recycle_time = 3600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009678] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.connection_trace = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009828] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.db_inc_retry_interval = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.009982] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.db_max_retries = 20 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.010134] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.db_max_retry_interval = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.010300] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.db_retry_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.010473] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.max_overflow = 50 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.010595] nova-scheduler[52224]: DEBUG nova.service [None req-82617efc-7d8e-435e-b269-9cda79a60e4e None None] Creating RPC server for service scheduler {{(pid=52224) start /opt/stack/nova/nova/service.py:182}} [ 449.010648] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.max_pool_size = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.010780] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.max_retries = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.010932] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.mysql_enable_ndb = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.011088] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.011240] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.mysql_wsrep_sync_wait = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.011401] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.pool_timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.011557] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.retry_interval = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.011739] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.slave_connection = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.011903] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.sqlite_synchronous = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.012070] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] database.use_db_reconnect = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.012244] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.backend = sqlalchemy {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.012419] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.connection = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.012579] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.connection_debug = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.012736] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.connection_parameters = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.012889] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.connection_recycle_time = 3600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013041] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.connection_trace = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013190] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.db_inc_retry_interval = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013341] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.db_max_retries = 20 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013489] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.db_max_retry_interval = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013639] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.db_retry_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013795] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.max_overflow = 50 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.013943] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.max_pool_size = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.014097] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.max_retries = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.014245] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.mysql_enable_ndb = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.014414] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.014561] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.014715] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.pool_timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.014869] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.retry_interval = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.015015] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.slave_connection = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.015166] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] api_database.sqlite_synchronous = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.015327] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] devices.enabled_mdev_types = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.015523] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.015696] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ephemeral_storage_encryption.enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.015867] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.016100] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.api_servers = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.016231] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.016387] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.016537] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.016709] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.016855] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017023] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.debug = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017178] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.default_trusted_certificate_ids = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017337] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.enable_certificate_validation = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017492] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.enable_rbd_download = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017643] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017794] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.017942] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.018165] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.018317] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.018472] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.num_retries = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.018647] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.rbd_ceph_conf = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.018780] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.rbd_connect_timeout = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.018938] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.rbd_pool = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.019093] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.rbd_user = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.019243] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.region_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.019416] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.019604] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.service_type = image {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.019754] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.019907] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.020188] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.020261] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.020491] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.020605] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.verify_glance_signatures = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.020758] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] glance.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.020934] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] guestfs.debug = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.021130] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.config_drive_cdrom = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.021287] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.config_drive_inject_password = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.021444] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.021612] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.enable_instance_metrics_collection = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.021821] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.enable_remotefx = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022013] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.instances_path_share = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022173] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.iscsi_initiator_list = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022334] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.limit_cpu_features = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022489] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022645] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022796] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.power_state_check_timeframe = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.022945] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.023101] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.023251] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.use_multipath_io = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.023416] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.volume_attach_retry_count = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.023561] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.023711] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.vswitch_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.023859] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.024075] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] mks.enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.024713] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.024919] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] image_cache.manager_interval = 2400 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.025084] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] image_cache.precache_concurrency = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.025348] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] image_cache.remove_unused_base_images = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.025410] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.025562] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.025727] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] image_cache.subdirectory_name = _base {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.025918] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.api_max_retries = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026073] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.api_retry_interval = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026223] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026384] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.auth_type = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026534] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026688] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026844] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.026997] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.027144] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.027290] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.027440] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.027586] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.027731] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.027877] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028039] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.partition_key = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028199] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.peer_list = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028346] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.region_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028497] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.serial_console_state_timeout = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028643] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028799] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.service_type = baremetal {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.028947] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.029093] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.029237] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.029422] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.029600] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.029752] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ironic.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.029791] nova-scheduler[52226]: DEBUG nova.service [None req-ddb63b4d-df76-4dae-b7f1-7dce4b0a39df None None] Join ServiceGroup membership for this service scheduler {{(pid=52226) start /opt/stack/nova/nova/service.py:199}} [ 449.030290] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.030357] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-ddb63b4d-df76-4dae-b7f1-7dce4b0a39df None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=52226) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 449.030398] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] key_manager.fixed_key = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.030398] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.030540] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.barbican_api_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.030708] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.barbican_endpoint = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.030902] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.barbican_endpoint_type = public {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.031071] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.barbican_region_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.031221] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.031368] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.031520] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.031697] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.031850] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032018] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.number_of_retries = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032182] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.retry_delay = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032366] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.send_service_user_token = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032521] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032668] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032838] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.verify_ssl = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.032986] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican.verify_ssl_path = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.033167] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.033334] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.auth_type = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.033485] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.033632] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.033787] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.033932] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.034077] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.034224] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.034370] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] barbican_service_user.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.034552] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.approle_role_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.034701] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.approle_secret_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.034911] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.035074] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.035251] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.035414] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.035561] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.035752] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.kv_mountpoint = secret {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.035902] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.kv_version = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.036065] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.namespace = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.036218] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.root_token_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.036401] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.036514] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.ssl_ca_crt_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.036662] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.036829] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.use_ssl = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.037083] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.037178] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.037317] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.037472] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.037625] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.037779] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038294] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038294] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038294] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038403] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038513] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038662] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.region_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038805] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.038962] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.service_type = identity {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.039109] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.039260] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.039438] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.039592] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.039766] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.039915] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] keystone.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.040155] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.connection_uri = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.040357] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_mode = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.040542] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_model_extra_flags = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.040710] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_models = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.040874] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_power_governor_high = performance {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.041030] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_power_governor_low = powersave {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.041183] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_power_management = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.041363] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.041536] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.device_detach_attempts = 8 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.041716] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.device_detach_timeout = 20 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.041876] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.disk_cachemodes = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042031] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.disk_prefix = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042188] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.enabled_perf_events = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042345] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.file_backed_memory = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042499] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.gid_maps = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042666] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.hw_disk_discard = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042813] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.hw_machine_type = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.042967] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_rbd_ceph_conf = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.043120] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.043295] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.043464] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_rbd_glance_store_name = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.043626] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_rbd_pool = rbd {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.043800] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_type = default {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.043928] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.images_volume_group = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.044094] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.inject_key = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.044280] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.inject_partition = -2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.044439] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.inject_password = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.044613] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.iscsi_iface = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.044773] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.iser_use_multipath = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.044917] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_bandwidth = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045076] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045227] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_downtime = 500 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045380] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045530] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045681] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_inbound_addr = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045831] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.045979] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_permit_post_copy = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.046145] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_scheme = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.046321] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_timeout_action = abort {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.046475] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_tunnelled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.046621] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_uri = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.046770] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.live_migration_with_native_tls = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.046915] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.max_queues = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.047088] nova-scheduler[52224]: DEBUG nova.service [None req-82617efc-7d8e-435e-b269-9cda79a60e4e None None] Join ServiceGroup membership for this service scheduler {{(pid=52224) start /opt/stack/nova/nova/service.py:199}} [ 449.047144] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.047330] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.nfs_mount_options = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.047524] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-82617efc-7d8e-435e-b269-9cda79a60e4e None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=52224) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 449.047579] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.047738] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048207] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.num_iser_scan_tries = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048207] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.num_memory_encrypted_guests = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048207] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048379] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.num_pcie_ports = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048522] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.num_volume_scan_tries = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048676] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.pmem_namespaces = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.048832] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.quobyte_client_cfg = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.049060] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.049216] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rbd_connect_timeout = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.049406] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.049548] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.049705] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rbd_secret_uuid = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.049845] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rbd_user = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050002] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050183] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.remote_filesystem_transport = ssh {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050339] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rescue_image_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050492] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rescue_kernel_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050640] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rescue_ramdisk_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050796] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.050947] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.rx_queue_size = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.051102] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.smbfs_mount_options = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.051327] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.051493] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.snapshot_compression = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.051669] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.snapshot_image_format = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.051890] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.052069] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.sparse_logical_volumes = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.052801] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.swtpm_enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.052801] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.swtpm_group = tss {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.052801] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.swtpm_user = tss {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.052801] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.sysinfo_serial = unique {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.052958] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.tx_queue_size = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.053084] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.uid_maps = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.053245] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.use_virtio_for_bridges = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.053410] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.virt_type = kvm {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.053566] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.volume_clear = zero {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.053725] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.volume_clear_size = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.053883] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.volume_use_multipath = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.054034] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_cache_path = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.054196] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.054356] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_mount_group = qemu {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.054522] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_mount_opts = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.054683] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.054895] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.055189] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.vzstorage_mount_user = stack {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.055222] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.055401] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.055570] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.auth_type = password {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.055726] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.055879] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056049] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056205] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056358] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056523] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.default_floating_pool = public {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056676] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056832] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.extension_sync_interval = 600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.056990] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.http_retries = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.057147] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.057324] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.057494] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.057657] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.057810] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.057966] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.ovs_bridge = br-int {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.058127] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.physnets = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.058309] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.region_name = RegionOne {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.058475] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.service_metadata_proxy = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.058630] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.058796] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.service_type = network {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.058955] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.059107] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.059262] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.059440] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.059621] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.059780] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] neutron.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.059950] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] notifications.bdms_in_notifications = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.060310] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] notifications.default_level = INFO {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.060310] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] notifications.notification_format = unversioned {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.060473] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] notifications.notify_on_state_change = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.060645] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.060813] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] pci.alias = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.060975] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] pci.device_spec = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.061133] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] pci.report_in_placement = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.061338] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.061511] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.auth_type = password {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.061693] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.auth_url = http://10.180.1.21/identity {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.061854] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062008] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062164] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062314] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062474] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062630] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.default_domain_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062781] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.default_domain_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.062931] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.domain_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063081] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.domain_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063231] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063383] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063533] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063683] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063832] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.063989] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.password = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.064161] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.project_domain_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.064343] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.project_domain_name = Default {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.064505] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.project_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.064702] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.project_name = service {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.064880] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.region_name = RegionOne {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065036] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065200] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.service_type = placement {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065357] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065512] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065662] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065838] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.system_scope = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.065992] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.066137] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.trust_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.066283] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.user_domain_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.066439] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.user_domain_name = Default {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.066612] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.user_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.066772] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.username = placement {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.066948] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.067102] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] placement.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.067280] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.cores = 20 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.067545] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.count_usage_from_placement = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.067732] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.067942] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.injected_file_content_bytes = 10240 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.068121] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.injected_file_path_length = 255 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.068286] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.injected_files = 5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.068452] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.instances = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.068617] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.key_pairs = 100 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.068891] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.metadata_items = 128 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.068928] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.ram = 51200 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.069083] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.recheck_quota = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.069386] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.server_group_members = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.069426] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] quota.server_groups = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.069603] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rdp.enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.069915] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.070128] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.070318] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.070501] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.image_metadata_prefilter = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.070725] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.070935] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.max_attempts = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.071102] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.max_placement_results = 1000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.071261] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.071443] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.query_placement_for_availability_zone = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.071618] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.query_placement_for_image_type_support = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.071794] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.071983] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] scheduler.workers = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.072217] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.072386] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.072586] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.072752] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.072910] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.073072] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.073233] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.073450] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.073633] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.host_subset_size = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.073805] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.073964] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.074121] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.isolated_hosts = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.074297] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.isolated_images = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.074456] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.074628] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.074782] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.pci_in_placement = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.074936] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.075107] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.075329] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.075489] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.075645] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.075799] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.075952] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.track_instance_changes = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.076134] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.076301] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metrics.required = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.076458] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metrics.weight_multiplier = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.076612] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.076775] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] metrics.weight_setting = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.077078] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.077278] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] serial_console.enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.077483] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] serial_console.port_range = 10000:20000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.077661] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.077927] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.077986] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] serial_console.serialproxy_port = 6083 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.078265] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.078301] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.auth_type = password {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.078453] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.078605] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.078759] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.078910] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.079059] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.079229] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.send_service_user_token = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.079415] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.079573] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] service_user.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.079736] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.agent_enabled = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.079893] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.080215] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.080438] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.080622] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.html5proxy_port = 6082 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.080781] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.image_compression = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.080933] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.jpeg_compression = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.081105] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.playback_compression = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.081269] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.server_listen = 127.0.0.1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.081461] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.081637] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.streaming_mode = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.081809] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] spice.zlib_compression = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082001] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] upgrade_levels.baseapi = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082156] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] upgrade_levels.cert = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082318] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] upgrade_levels.compute = auto {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082470] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] upgrade_levels.conductor = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082618] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] upgrade_levels.scheduler = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082793] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.082942] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.auth_type = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083094] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083240] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083392] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083545] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083694] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083846] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.083994] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vendordata_dynamic_auth.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.084226] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.api_retry_count = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.084384] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.ca_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.084562] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.cache_prefix = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.084715] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.cluster_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.084888] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.connection_pool_size = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085042] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.console_delay_seconds = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085192] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.datastore_regex = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085345] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.host_ip = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085504] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.host_password = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085659] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.host_port = 443 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085811] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.host_username = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.085963] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.086113] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.integration_bridge = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.086266] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.maximum_objects = 100 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.086420] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.pbm_default_policy = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.086572] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.pbm_enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.086722] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.pbm_wsdl_location = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.086879] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.087030] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.serial_port_proxy_uri = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.087177] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.serial_port_service_uri = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.087358] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.task_poll_interval = 0.5 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.087525] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.use_linked_clone = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.087687] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.vnc_keymap = en-us {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.087848] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.vnc_port = 5900 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.088011] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vmware.vnc_port_total = 10000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.088204] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.auth_schemes = ['none'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.088375] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.enabled = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.088675] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.088853] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.089015] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.novncproxy_port = 6080 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.089184] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.server_listen = 127.0.0.1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.089369] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.089537] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.vencrypt_ca_certs = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.089693] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.vencrypt_client_cert = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.089914] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] vnc.vencrypt_client_key = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090024] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090278] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.disable_deep_image_inspection = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090324] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090475] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090628] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090785] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.disable_rootwrap = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.090940] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.enable_numa_live_migration = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.091092] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.091244] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.091395] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.091546] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.libvirt_disable_apic = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.091722] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.091884] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092048] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092207] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092360] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092516] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092673] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092827] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.092977] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.093134] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.093332] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.093497] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.client_socket_timeout = 900 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.093655] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.default_pool_size = 1000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.093812] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.keep_alive = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.093971] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.max_header_line = 16384 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.094125] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.secure_proxy_ssl_header = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.094280] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.ssl_ca_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.094435] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.ssl_cert_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.094586] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.ssl_key_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.094745] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.tcp_keepidle = 600 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.094917] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.095076] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] zvm.ca_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.095230] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] zvm.cloud_connector_url = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.095447] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.095610] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] zvm.reachable_timeout = 300 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.095813] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.095971] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.096142] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.096308] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.096468] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.096671] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.enforce_new_defaults = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.096852] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.enforce_scope = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.097019] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.policy_default_rule = default {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.097208] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.097455] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.policy_file = policy.yaml {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.097585] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.097840] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.097877] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.098050] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.098203] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.098392] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.098567] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.098774] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.connection_string = messaging:// {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.098940] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.enabled = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.099121] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.es_doc_type = notification {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.099316] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.es_scroll_size = 10000 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.099494] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.es_scroll_time = 2m {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.099654] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.filter_error_trace = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.099814] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.hmac_keys = SECRET_KEY {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.099973] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.sentinel_service_name = mymaster {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.100144] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.socket_timeout = 0.1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.100305] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] profiler.trace_sqlalchemy = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.100462] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] remote_debug.host = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.100612] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] remote_debug.port = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.100794] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.100955] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.101114] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.101269] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.101429] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.101588] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.101770] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.101930] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.102085] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.102240] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.102408] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.102571] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.102736] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.102895] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.103048] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.103218] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.103372] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.103528] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.103686] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.103847] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104007] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104174] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104329] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104489] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104651] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104816] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.ssl = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.104979] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.105141] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.105294] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.105460] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.105625] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_rabbit.ssl_version = {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106378] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106378] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_notifications.retry = -1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106378] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106378] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_messaging_notifications.transport_url = **** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106522] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.auth_section = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106675] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.auth_type = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106828] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.cafile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.106979] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.certfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.107610] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.collect_timing = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.107610] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.connect_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.107610] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.connect_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.107610] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.endpoint_id = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.107774] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.endpoint_override = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.107886] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.insecure = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108047] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.keyfile = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108200] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.max_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108350] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.min_version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108501] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.region_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108654] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.service_name = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108824] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.service_type = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.108984] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.split_loggers = False {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.109137] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.status_code_retries = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.109325] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.status_code_retry_delay = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.109466] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.timeout = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.109620] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.valid_interfaces = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.109772] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_limit.version = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.109959] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_reports.file_event_handler = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.110109] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.110288] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] oslo_reports.log_dir = None {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 449.110414] nova-scheduler[51345]: DEBUG oslo_service.service [None req-cdd273f8-63b6-4751-b8aa-b8d596305c54 None None] ******************************************************************************** {{(pid=51345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 569.671908] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Starting to schedule for instances: ['0a5a58c1-5d00-4627-9024-7a2dba470a5b'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 569.672628] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 569.672823] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 569.673116] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 569.674579] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 569.674855] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 570.544868] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.545169] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.546787] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 570.550308] nova-scheduler[52226]: DEBUG oslo_db.sqlalchemy.engines [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52226) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 570.564414] nova-scheduler[52226]: DEBUG oslo_db.sqlalchemy.engines [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Parent process 51345 forked (52226) with an open database connection, which is being discarded and recreated. {{(pid=52226) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 570.571599] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.571815] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.571991] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 570.574570] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.574994] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.576174] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:01:32Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 570.576671] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 570.576848] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 570.577000] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 570.577165] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 570.577546] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 570.577825] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.578046] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.578333] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.578530] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.578712] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.578893] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.579054] nova-scheduler[52226]: DEBUG nova.filters [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 570.579225] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 570.579510] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 570.579756] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Attempting to claim resources in the placement API for instance 0a5a58c1-5d00-4627-9024-7a2dba470a5b {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 570.644893] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] [instance: 0a5a58c1-5d00-4627-9024-7a2dba470a5b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 570.645264] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 570.645451] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 570.645656] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2832153b-a552-4c54-b7f3-fff48a350bcc tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 579.914753] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Starting to schedule for instances: ['8692a31c-7ae6-41f9-8776-fbd8147b036d'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 579.915396] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 579.915795] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 579.915900] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 579.916225] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 579.916484] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 579.990080] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 579.990370] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.000520] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.009213] nova-scheduler[52224]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52224) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 580.027143] nova-scheduler[52224]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Parent process 51345 forked (52224) with an open database connection, which is being discarded and recreated. {{(pid=52224) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 580.034986] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.035195] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.035367] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.045653] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.045653] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.046647] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_task_None='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:12Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 580.047050] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 580.047225] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 580.047396] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 580.047570] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.047962] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 580.048365] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.048574] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.048855] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.049056] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.049217] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.049426] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.049591] nova-scheduler[52224]: DEBUG nova.filters [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.049759] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 580.050028] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 580.050263] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Attempting to claim resources in the placement API for instance 8692a31c-7ae6-41f9-8776-fbd8147b036d {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 580.123164] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] [instance: 8692a31c-7ae6-41f9-8776-fbd8147b036d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 580.123529] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.123909] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.123997] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-b7e3c76f-7f99-46ec-b0f6-cc6922905965 tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.238603] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Starting to schedule for instances: ['0ae2e997-07e4-4459-a4ce-5dab10dc73bc'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 580.239041] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 580.239202] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 580.239542] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 580.239918] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 580.240373] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 580.291087] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.291353] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.291529] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.298119] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.298318] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.298476] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.300963] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.301159] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.301971] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_task_None='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:12Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 580.301971] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 580.302115] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 580.302115] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 580.302260] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 580.302518] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 580.302717] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304298] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304298] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304298] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304298] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304298] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304710] nova-scheduler[52226]: DEBUG nova.filters [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 580.304710] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 580.304710] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 580.304710] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Attempting to claim resources in the placement API for instance 0ae2e997-07e4-4459-a4ce-5dab10dc73bc {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 580.373848] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] [instance: 0ae2e997-07e4-4459-a4ce-5dab10dc73bc] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 580.374140] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 580.374341] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 580.374534] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a47f2247-e459-4ab5-9d15-4d542e95eec6 tempest-ServerDiagnosticsTest-1339754538 tempest-ServerDiagnosticsTest-1339754538-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.790325] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting to schedule for instances: ['41375a05-ca0f-487a-8fe1-8d6904d71e8a'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 583.790780] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 583.790941] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 583.791238] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 583.791442] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 583.791664] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 583.842353] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.842600] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.842774] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.849189] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.849433] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.849606] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.853086] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.853310] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.853691] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='1',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_f65c4b2c468f49138949e1dc4f9ba91c='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:14Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=2) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 583.854062] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with aggregates: [Aggregate(created_at=2024-07-30T07:02:12Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1677313740',updated_at=None,uuid=f1a05ba7-1b2d-4365-a674-f749f443361a)] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 583.854236] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 583.854396] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with instances: ['8692a31c-7ae6-41f9-8776-fbd8147b036d', '0ae2e997-07e4-4459-a4ce-5dab10dc73bc'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 583.854564] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.854823] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 583.855026] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.855236] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.855518] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.855581] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.855714] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.855879] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.856052] nova-scheduler[52224]: DEBUG nova.filters [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.856211] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 583.856380] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 583.856553] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Attempting to claim resources in the placement API for instance 41375a05-ca0f-487a-8fe1-8d6904d71e8a {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 583.940860] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] [instance: 41375a05-ca0f-487a-8fe1-8d6904d71e8a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 583.941356] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.941699] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.942113] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-065b50fd-b05f-46b2-93ad-0755bb860b6b tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.666718] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Starting to schedule for instances: ['768e766b-0202-4c34-b660-73a6ebcf86bd'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 585.667161] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 585.667254] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 585.667498] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 585.667598] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 585.667879] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 585.707802] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.707802] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.708037] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.714345] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.714549] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.714706] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.717609] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.717824] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.718202] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='1',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_f65c4b2c468f49138949e1dc4f9ba91c='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:18Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 585.718567] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Update host state with aggregates: [Aggregate(created_at=2024-07-30T07:02:12Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1677313740',updated_at=None,uuid=f1a05ba7-1b2d-4365-a674-f749f443361a)] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 585.718744] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 585.718927] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Update host state with instances: ['8692a31c-7ae6-41f9-8776-fbd8147b036d', '0ae2e997-07e4-4459-a4ce-5dab10dc73bc', '41375a05-ca0f-487a-8fe1-8d6904d71e8a'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 585.719068] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 585.719401] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 585.719632] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.719817] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.720039] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.720195] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.720639] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.720847] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.721016] nova-scheduler[52226]: DEBUG nova.filters [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 585.721178] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 585.721347] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 585.721523] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Attempting to claim resources in the placement API for instance 768e766b-0202-4c34-b660-73a6ebcf86bd {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 585.786490] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] [instance: 768e766b-0202-4c34-b660-73a6ebcf86bd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 585.786795] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 585.787003] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 585.787448] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-ddd5c178-b88e-4562-bea8-926db72d8cb9 tempest-TenantUsagesTestJSON-1378519432 tempest-TenantUsagesTestJSON-1378519432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.880725] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting to schedule for instances: ['1349077c-c3ca-4cfe-b43e-92b48887aa66'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 588.881069] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 588.881167] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 588.881339] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 588.881524] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 588.881717] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 588.927923] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.927923] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.927923] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.935730] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.936267] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.936610] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.939994] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.940341] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.940876] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='1',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='1',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_f65c4b2c468f49138949e1dc4f9ba91c='0',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:21Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 588.941468] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 588.941757] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 588.942075] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with instances: ['41375a05-ca0f-487a-8fe1-8d6904d71e8a', '768e766b-0202-4c34-b660-73a6ebcf86bd'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 588.942364] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.942771] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 588.943106] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.943420] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.943758] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.944063] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.944376] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.944911] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.945196] nova-scheduler[52224]: DEBUG nova.filters [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.945511] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 588.945820] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 588.946155] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Attempting to claim resources in the placement API for instance 1349077c-c3ca-4cfe-b43e-92b48887aa66 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 589.094805] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] [instance: 1349077c-c3ca-4cfe-b43e-92b48887aa66] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 589.095089] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 589.095281] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 589.095499] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-68effc5a-2838-40a1-ac5b-f4661f653418 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.896791] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Starting to schedule for instances: ['ec9941ee-163d-416e-a767-d479897e9e39'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 590.897068] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 590.897226] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.897470] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.897731] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.897913] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 590.941728] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 590.941728] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 590.941867] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.950088] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 590.950358] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 590.950476] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.955824] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 590.956078] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 590.956454] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='3',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='1',num_proj_59f74bb6dc524b91ba810698b0d426bc='1',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_f65c4b2c468f49138949e1dc4f9ba91c='0',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:24Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=2) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 590.956827] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 590.956945] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 590.957094] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Update host state with instances: ['768e766b-0202-4c34-b660-73a6ebcf86bd', '1349077c-c3ca-4cfe-b43e-92b48887aa66'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 590.957297] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.957578] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 590.957748] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.957931] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.958121] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.958275] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.958717] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.958717] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.958783] nova-scheduler[52226]: DEBUG nova.filters [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 590.958916] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 590.959073] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 590.959238] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Attempting to claim resources in the placement API for instance ec9941ee-163d-416e-a767-d479897e9e39 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 591.016173] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] [instance: ec9941ee-163d-416e-a767-d479897e9e39] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 591.016485] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.016694] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.016896] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-d185b984-3f9b-4516-81b1-7750c2a6c572 tempest-ServersTestJSON-208056556 tempest-ServersTestJSON-208056556-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.242551] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Starting to schedule for instances: ['9ed0f4a6-2282-45a0-855b-af9d27fad22b'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 593.242741] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 593.242774] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.243056] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.243159] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 593.243348] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 593.283040] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.283273] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.283443] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.289718] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.289924] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.290088] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.292030] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.292225] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.292576] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='4',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='1',num_proj_59f74bb6dc524b91ba810698b0d426bc='1',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='1',num_proj_f65c4b2c468f49138949e1dc4f9ba91c='0',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:25Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 593.292853] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 593.293023] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 593.293181] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with instances: ['768e766b-0202-4c34-b660-73a6ebcf86bd', '1349077c-c3ca-4cfe-b43e-92b48887aa66', 'ec9941ee-163d-416e-a767-d479897e9e39'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 593.293341] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 593.293594] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 593.293794] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.293974] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.294166] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.294407] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.294496] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.294658] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.294818] nova-scheduler[52224]: DEBUG nova.filters [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 593.294971] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 593.295136] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 593.295310] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Attempting to claim resources in the placement API for instance 9ed0f4a6-2282-45a0-855b-af9d27fad22b {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 593.342671] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] [instance: 9ed0f4a6-2282-45a0-855b-af9d27fad22b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 593.342975] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 593.343180] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 593.343384] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-647ad496-ad67-47ad-88a1-1fc0cc665f54 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.711599] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Starting to schedule for instances: ['6e6f626b-deda-4ce8-85a3-62f7c335f19c'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 595.711945] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 595.712081] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.712306] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.712537] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 595.712750] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 595.758068] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.758296] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.758463] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.764660] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.764870] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.765089] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.767446] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.767664] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.768238] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='4',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='1',num_proj_fe93513973214329b9bf2cb4f49b6e22='1',num_task_None='1',num_task_spawning='1',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=2) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 595.768348] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 595.768693] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 595.768693] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with instances: ['ec9941ee-163d-416e-a767-d479897e9e39', '9ed0f4a6-2282-45a0-855b-af9d27fad22b'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 595.768908] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 595.769294] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 595.769294] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.769463] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.769666] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.769851] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.770014] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.770177] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.770352] nova-scheduler[52226]: DEBUG nova.filters [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 595.770526] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 595.770721] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 595.770878] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Attempting to claim resources in the placement API for instance 6e6f626b-deda-4ce8-85a3-62f7c335f19c {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 595.822760] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] [instance: 6e6f626b-deda-4ce8-85a3-62f7c335f19c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 595.822760] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 595.822760] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 595.822991] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-59440c23-371f-47f7-b7ef-a78e92cc23ef tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 596.965709] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['57852791-d8a4-41d2-bf48-e1689877fb21'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 596.966074] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 596.966176] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 596.966349] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 596.966536] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 596.966706] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 597.026474] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.026700] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.026860] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.033609] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.033821] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.034199] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.036349] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.036642] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.036895] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='1',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='2',num_task_spawning='1',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:30Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 597.037166] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 597.037340] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 597.037495] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: ['ec9941ee-163d-416e-a767-d479897e9e39', '9ed0f4a6-2282-45a0-855b-af9d27fad22b', '6e6f626b-deda-4ce8-85a3-62f7c335f19c'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 597.037652] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.037899] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 597.038093] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.038263] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.038454] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.038612] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.038891] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.039004] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.039075] nova-scheduler[52224]: DEBUG nova.filters [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.039219] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 597.039405] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 597.039581] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Attempting to claim resources in the placement API for instance 57852791-d8a4-41d2-bf48-e1689877fb21 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 597.115625] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] [instance: 57852791-d8a4-41d2-bf48-e1689877fb21] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 597.115625] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.115788] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.116160] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3902dff8-a731-4a10-821f-002503a59e39 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.395488] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Starting to schedule for instances: ['8bbe5c93-3766-4593-b9f1-a88471df29ea'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 597.395488] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 597.395488] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 597.395488] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 597.396226] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 597.396226] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 597.453382] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.453585] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.453766] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.464769] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.464986] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.465148] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.467709] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.467910] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.468307] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='6',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='2',num_task_spawning='0',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:31Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=2) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 597.468633] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 597.468803] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 597.468957] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Update host state with instances: ['9ed0f4a6-2282-45a0-855b-af9d27fad22b', '6e6f626b-deda-4ce8-85a3-62f7c335f19c', '57852791-d8a4-41d2-bf48-e1689877fb21'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 597.469117] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 597.469388] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 597.469614] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.469782] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.469974] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.470136] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.470294] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.470470] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.470628] nova-scheduler[52226]: DEBUG nova.filters [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 597.470780] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 597.471055] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 597.471255] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Attempting to claim resources in the placement API for instance 8bbe5c93-3766-4593-b9f1-a88471df29ea {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 597.559653] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] [instance: 8bbe5c93-3766-4593-b9f1-a88471df29ea] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 597.559947] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 597.560223] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 597.560440] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a57e0e44-4ac0-4239-96ed-3eb4af8b3422 tempest-ServersWithSpecificFlavorTestJSON-281401549 tempest-ServersWithSpecificFlavorTestJSON-281401549-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 598.601613] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Starting to schedule for instances: ['8851ad3e-2e6b-42b3-9b02-a693ddaba993'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 598.601917] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 598.602080] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 598.602259] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 598.602468] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 598.602713] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 598.658254] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 598.658481] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 598.658644] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 598.665206] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 598.665411] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 598.665567] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 598.667605] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 598.667819] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 598.668183] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='6',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='4',num_task_spawning='0',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:31Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=4) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 598.668463] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 598.668628] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 598.668780] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Update host state with instances: ['9ed0f4a6-2282-45a0-855b-af9d27fad22b', '6e6f626b-deda-4ce8-85a3-62f7c335f19c', '57852791-d8a4-41d2-bf48-e1689877fb21', '8bbe5c93-3766-4593-b9f1-a88471df29ea'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 598.668938] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 598.669183] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 598.669410] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.669596] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.669788] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.670013] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.670104] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.670260] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.670415] nova-scheduler[52224]: DEBUG nova.filters [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 598.670568] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 598.670734] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 598.670893] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Attempting to claim resources in the placement API for instance 8851ad3e-2e6b-42b3-9b02-a693ddaba993 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 598.718011] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] [instance: 8851ad3e-2e6b-42b3-9b02-a693ddaba993] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 598.718325] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 598.718533] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 598.718737] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1b8f5892-0a9a-4d99-90d7-a8a1dd6032f1 tempest-ListServerFiltersTestJSON-344798180 tempest-ListServerFiltersTestJSON-344798180-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.085215] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Starting to schedule for instances: ['4343e7c2-bd98-44af-b060-6f6ca6daa144'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 600.085512] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 600.085683] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.085990] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.086068] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.086244] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 600.140089] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.140552] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.140552] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.147504] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.147701] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.147862] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.149852] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.150047] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.150396] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195502,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1088,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='7',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='4',num_task_spawning='0',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:33Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=4) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 600.150699] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 600.150870] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 600.151028] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Update host state with instances: ['6e6f626b-deda-4ce8-85a3-62f7c335f19c', '57852791-d8a4-41d2-bf48-e1689877fb21', '8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 600.151189] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.151432] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 600.151633] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.151819] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.152016] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.152185] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.152343] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.152503] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.152659] nova-scheduler[52226]: DEBUG nova.filters [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.152810] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195502MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 600.152973] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195502MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 600.153136] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Attempting to claim resources in the placement API for instance 4343e7c2-bd98-44af-b060-6f6ca6daa144 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 600.215635] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] [instance: 4343e7c2-bd98-44af-b060-6f6ca6daa144] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195502MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 600.216073] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.216375] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.216928] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-87d45b4e-519f-4544-8134-c855c180ee3b tempest-DeleteServersAdminTestJSON-1589661857 tempest-DeleteServersAdminTestJSON-1589661857-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.805433] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting to schedule for instances: ['27c66836-6f7c-45a7-857f-2255137f90fb'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 600.805713] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 600.805879] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.806051] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.806245] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 600.806421] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 600.856770] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.856770] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.856770] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.864475] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.864886] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.865176] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.867884] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.868235] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.868836] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195374,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1216,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='7',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='5',num_task_spawning='0',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:34Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 600.869267] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 600.869650] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 600.869968] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with instances: ['6e6f626b-deda-4ce8-85a3-62f7c335f19c', '57852791-d8a4-41d2-bf48-e1689877fb21', '8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993', '4343e7c2-bd98-44af-b060-6f6ca6daa144'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 600.870275] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 600.870655] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 600.871016] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.871336] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.871766] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.872314] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.872738] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.873060] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.873439] nova-scheduler[52224]: DEBUG nova.filters [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 600.873709] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195374MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 600.873984] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195374MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 600.874267] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Attempting to claim resources in the placement API for instance 27c66836-6f7c-45a7-857f-2255137f90fb {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 600.928115] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] [instance: 27c66836-6f7c-45a7-857f-2255137f90fb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195374MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 600.928115] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 600.928115] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 600.928323] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0eac7ea8-2635-4660-b7ea-4ebff5d9e1cb tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 601.638149] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Starting to schedule for instances: ['2a410ec2-1648-4e57-8a18-e9bd316218cb'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 601.638149] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 601.638149] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 601.638149] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 601.638149] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 601.638531] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 601.686321] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 601.686758] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 601.687010] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 601.702335] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 601.703460] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 601.703714] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 601.708375] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 601.708616] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 601.712446] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195246,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1344,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='8',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='6',num_task_spawning='0',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:35Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=6) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 601.714104] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 601.714104] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 601.714104] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Update host state with instances: ['6e6f626b-deda-4ce8-85a3-62f7c335f19c', '57852791-d8a4-41d2-bf48-e1689877fb21', '8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993', '4343e7c2-bd98-44af-b060-6f6ca6daa144', '27c66836-6f7c-45a7-857f-2255137f90fb'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 601.714309] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 601.714309] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 601.714309] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.714309] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.714309] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.714509] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.714747] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.714993] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.715539] nova-scheduler[52226]: DEBUG nova.filters [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 601.715539] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195246MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 601.715655] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195246MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 601.715846] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Attempting to claim resources in the placement API for instance 2a410ec2-1648-4e57-8a18-e9bd316218cb {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 601.774256] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] [instance: 2a410ec2-1648-4e57-8a18-e9bd316218cb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195246MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 601.774548] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 601.774750] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 601.774950] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-307b655c-f890-47be-a5b3-b75b0b382ed6 tempest-MigrationsAdminTest-1746949297 tempest-MigrationsAdminTest-1746949297-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.157001] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Starting to schedule for instances: ['4663f38b-97ac-4560-9c8c-7edbdb889aec'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 602.157676] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 602.157676] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.157676] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.157882] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.158055] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 602.238915] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.239131] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.239331] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.260329] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.260329] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.260519] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.263393] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.263607] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.266323] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195246,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1344,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='8',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='2',num_task_None='6',num_task_spawning='0',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:35Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=6) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 602.267274] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 602.267477] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 602.267640] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Update host state with instances: ['6e6f626b-deda-4ce8-85a3-62f7c335f19c', '57852791-d8a4-41d2-bf48-e1689877fb21', '8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993', '4343e7c2-bd98-44af-b060-6f6ca6daa144', '27c66836-6f7c-45a7-857f-2255137f90fb', '2a410ec2-1648-4e57-8a18-e9bd316218cb'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 602.267803] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.004s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.268103] nova-scheduler[52224]: DEBUG nova.filters [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 602.268365] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 60.166235 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 602.268562] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195246MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 602.268728] nova-scheduler[52224]: INFO nova.filters [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Filter ComputeFilter returned 0 hosts [ 602.268893] nova-scheduler[52224]: DEBUG nova.filters [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Filtering removed all hosts for the request with instance ID '4663f38b-97ac-4560-9c8c-7edbdb889aec'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 602.269031] nova-scheduler[52224]: INFO nova.filters [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Filtering removed all hosts for the request with instance ID '4663f38b-97ac-4560-9c8c-7edbdb889aec'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 602.269207] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 602.269336] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e8cba17-7a3f-4a9f-aa99-a69ea62ef15f tempest-ServersAdminNegativeTestJSON-1729605402 tempest-ServersAdminNegativeTestJSON-1729605402-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 603.379618] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Starting to schedule for instances: ['51c15451-5f95-4c9a-80f5-039aa2a76471'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 603.379618] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 603.379618] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.379618] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.380134] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.380134] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 603.418136] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.418589] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.418969] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.427481] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.427864] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.428235] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.430443] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.430842] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.431398] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195374,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1216,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='8',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='1',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='1',num_task_None='5',num_task_spawning='0',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:37Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 603.431898] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 603.432250] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 603.432573] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Update host state with instances: ['8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993', '4343e7c2-bd98-44af-b060-6f6ca6daa144', '27c66836-6f7c-45a7-857f-2255137f90fb', '2a410ec2-1648-4e57-8a18-e9bd316218cb'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 603.432900] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.433309] nova-scheduler[52226]: DEBUG nova.filters [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 603.433723] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 61.331578 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 603.434072] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195374MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 603.434388] nova-scheduler[52226]: INFO nova.filters [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Filter ComputeFilter returned 0 hosts [ 603.434699] nova-scheduler[52226]: DEBUG nova.filters [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Filtering removed all hosts for the request with instance ID '51c15451-5f95-4c9a-80f5-039aa2a76471'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 603.434986] nova-scheduler[52226]: INFO nova.filters [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Filtering removed all hosts for the request with instance ID '51c15451-5f95-4c9a-80f5-039aa2a76471'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 603.435271] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 603.435575] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-77d54aca-47b6-4118-8002-47dfdea07b87 tempest-ServerDiagnosticsNegativeTest-120108435 tempest-ServerDiagnosticsNegativeTest-120108435-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 607.850711] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Starting to schedule for instances: ['ecc9ed0b-5298-45e5-b7c1-c2ea275870d0'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 607.851162] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 607.851162] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.851357] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.851556] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.851743] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 607.892364] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.892606] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.892792] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.899798] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.899798] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.899939] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.902486] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.902486] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.902603] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195374,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1216,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='8',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='1',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='1',num_task_None='5',num_task_spawning='0',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:37Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 607.902862] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 607.903364] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 607.903364] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Update host state with instances: ['8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993', '4343e7c2-bd98-44af-b060-6f6ca6daa144', '27c66836-6f7c-45a7-857f-2255137f90fb', '2a410ec2-1648-4e57-8a18-e9bd316218cb'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 607.903364] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.903656] nova-scheduler[52224]: DEBUG nova.filters [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 607.905634] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 65.801631 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 607.905634] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195374MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 607.905634] nova-scheduler[52224]: INFO nova.filters [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Filter ComputeFilter returned 0 hosts [ 607.905634] nova-scheduler[52224]: DEBUG nova.filters [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Filtering removed all hosts for the request with instance ID 'ecc9ed0b-5298-45e5-b7c1-c2ea275870d0'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 607.905634] nova-scheduler[52224]: INFO nova.filters [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Filtering removed all hosts for the request with instance ID 'ecc9ed0b-5298-45e5-b7c1-c2ea275870d0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 607.906029] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 607.906029] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-6eabfeac-72eb-4e98-9235-ef1ab4b8676b tempest-VolumesAssistedSnapshotsTest-904669113 tempest-VolumesAssistedSnapshotsTest-904669113-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 608.043500] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Starting to schedule for instances: ['97a12200-467c-49ff-aa63-5c5e0ecf1b13'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 608.043500] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 608.043500] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.043500] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.043500] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.043904] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 608.093203] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.093425] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.093589] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.100803] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.101019] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.101179] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.103214] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.103418] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.103775] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195374,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1216,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='8',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='1',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='1',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='1',num_task_None='5',num_task_spawning='0',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:37Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 608.104061] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 608.104225] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 608.104374] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Update host state with instances: ['8bbe5c93-3766-4593-b9f1-a88471df29ea', '8851ad3e-2e6b-42b3-9b02-a693ddaba993', '4343e7c2-bd98-44af-b060-6f6ca6daa144', '27c66836-6f7c-45a7-857f-2255137f90fb'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 608.104529] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.104836] nova-scheduler[52226]: DEBUG nova.filters [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 608.105052] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 66.002963 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 608.105310] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195374MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 608.105490] nova-scheduler[52226]: INFO nova.filters [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Filter ComputeFilter returned 0 hosts [ 608.105637] nova-scheduler[52226]: DEBUG nova.filters [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Filtering removed all hosts for the request with instance ID '97a12200-467c-49ff-aa63-5c5e0ecf1b13'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 608.105772] nova-scheduler[52226]: INFO nova.filters [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Filtering removed all hosts for the request with instance ID '97a12200-467c-49ff-aa63-5c5e0ecf1b13'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 608.105915] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 608.106056] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e9ea141f-7ce9-4fe0-991b-bbebfabd375e tempest-ServerDiagnosticsV248Test-1918011109 tempest-ServerDiagnosticsV248Test-1918011109-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 608.629494] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting to schedule for instances: ['9441e4fa-0bf8-4dda-9ec8-228925a783d4'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 608.629494] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 608.629648] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.629897] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.630042] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.630235] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 608.680649] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.680926] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.681051] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.689229] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.689486] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.689676] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.694574] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.694791] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.695273] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195630,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=960,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='10',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='1',num_proj_3ff909bdf0ad4132958081b4a8e2db57='1',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='1',num_task_None='3',num_task_spawning='0',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:42Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 608.695451] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 608.695626] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 608.695789] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with instances: ['4343e7c2-bd98-44af-b060-6f6ca6daa144', '27c66836-6f7c-45a7-857f-2255137f90fb'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 608.700249] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.701705] nova-scheduler[52224]: DEBUG nova.filters [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 608.701705] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 66.598906 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 608.701705] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195630MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 608.701705] nova-scheduler[52224]: INFO nova.filters [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ComputeFilter returned 0 hosts [ 608.701705] nova-scheduler[52224]: DEBUG nova.filters [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID '9441e4fa-0bf8-4dda-9ec8-228925a783d4'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 608.701917] nova-scheduler[52224]: INFO nova.filters [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID '9441e4fa-0bf8-4dda-9ec8-228925a783d4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 608.701917] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 608.701917] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9f77b257-fdd4-4c49-9c95-e968494b8948 tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 611.685805] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Starting to schedule for instances: ['ce109f7d-c28e-45d2-8272-c3d9bd84050c'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 611.685805] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 611.685805] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.685805] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.685805] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.686220] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 611.741128] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.741353] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.741515] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.748244] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.748433] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.748590] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.752340] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.752560] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.752931] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 611.753227] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 611.753400] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 611.753557] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 611.753720] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.753978] nova-scheduler[52226]: DEBUG nova.filters [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 611.754188] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 69.652104 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 611.754347] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 611.754514] nova-scheduler[52226]: INFO nova.filters [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Filter ComputeFilter returned 0 hosts [ 611.754738] nova-scheduler[52226]: DEBUG nova.filters [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Filtering removed all hosts for the request with instance ID 'ce109f7d-c28e-45d2-8272-c3d9bd84050c'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 611.754970] nova-scheduler[52226]: INFO nova.filters [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Filtering removed all hosts for the request with instance ID 'ce109f7d-c28e-45d2-8272-c3d9bd84050c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 611.755219] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 611.755483] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-76bebdef-40d9-4f36-a132-c411cb227400 tempest-ImagesNegativeTestJSON-1653915252 tempest-ImagesNegativeTestJSON-1653915252-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 611.847945] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Starting to schedule for instances: ['2231316b-b58a-4e99-871a-14e9120617b8'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 611.848165] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 611.848399] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.848501] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.848695] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.848879] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 611.896393] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.896677] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.896916] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.904629] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.904844] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.905075] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.906943] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.907148] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.907623] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 611.907923] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 611.908121] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 611.908281] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 611.908493] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.908706] nova-scheduler[52224]: DEBUG nova.filters [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 611.908919] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 69.806835 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 611.909073] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 611.909224] nova-scheduler[52224]: INFO nova.filters [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Filter ComputeFilter returned 0 hosts [ 611.909660] nova-scheduler[52224]: DEBUG nova.filters [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Filtering removed all hosts for the request with instance ID '2231316b-b58a-4e99-871a-14e9120617b8'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 611.909788] nova-scheduler[52224]: INFO nova.filters [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Filtering removed all hosts for the request with instance ID '2231316b-b58a-4e99-871a-14e9120617b8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 611.909947] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 611.910096] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-c07044c9-ba5e-49c6-99a8-bb79554eb043 tempest-FloatingIPsAssociationTestJSON-167867001 tempest-FloatingIPsAssociationTestJSON-167867001-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 615.458025] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['e5678d8e-71f3-4b78-a1a1-0776e2edd088'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 615.458025] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 615.458259] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.458259] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.458970] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.458970] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 615.516169] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.516169] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.516169] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.522835] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.523176] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.523534] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.525667] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.525973] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.526435] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 615.526885] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 615.527169] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 615.527477] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 615.527749] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.528161] nova-scheduler[52226]: DEBUG nova.filters [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 615.528500] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 73.426389 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 615.528773] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 615.529106] nova-scheduler[52226]: INFO nova.filters [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 0 hosts [ 615.529345] nova-scheduler[52226]: DEBUG nova.filters [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID 'e5678d8e-71f3-4b78-a1a1-0776e2edd088'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 615.529610] nova-scheduler[52226]: INFO nova.filters [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID 'e5678d8e-71f3-4b78-a1a1-0776e2edd088'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 615.529886] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 615.530139] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-633030ee-7d6b-48ae-801e-2ba620cf1e49 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 618.903156] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting to schedule for instances: ['04aa8c4c-011c-4bcc-89af-b03c4a3b33e5'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 618.903156] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 618.903156] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.903156] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.903156] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.904035] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 618.979356] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.979595] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.979768] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.986226] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.986423] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.986584] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.988632] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.988857] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.989206] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 618.989549] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 618.989717] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 618.989868] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 618.990027] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.990489] nova-scheduler[52224]: DEBUG nova.filters [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 618.990489] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 76.888401 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 618.990641] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 618.990783] nova-scheduler[52224]: INFO nova.filters [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ComputeFilter returned 0 hosts [ 618.990925] nova-scheduler[52224]: DEBUG nova.filters [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtering removed all hosts for the request with instance ID '04aa8c4c-011c-4bcc-89af-b03c4a3b33e5'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 618.991057] nova-scheduler[52224]: INFO nova.filters [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtering removed all hosts for the request with instance ID '04aa8c4c-011c-4bcc-89af-b03c4a3b33e5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 618.991206] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 618.991344] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-7b69d082-7c9f-429b-93d5-ed3edba75784 tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 619.904478] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting to schedule for instances: ['e35e8fe9-8b00-4f5b-8139-125534feca3f'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 619.904775] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 619.904931] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.905137] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.905300] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.905485] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 619.950358] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.950613] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.950776] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.958396] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.958603] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.958763] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.960657] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.960850] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.961269] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 619.961620] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 619.961786] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 619.961938] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 619.962091] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.962342] nova-scheduler[52226]: DEBUG nova.filters [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 619.962541] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 77.860466 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 619.962698] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 619.962901] nova-scheduler[52226]: INFO nova.filters [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ComputeFilter returned 0 hosts [ 619.962987] nova-scheduler[52226]: DEBUG nova.filters [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID 'e35e8fe9-8b00-4f5b-8139-125534feca3f'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 619.963119] nova-scheduler[52226]: INFO nova.filters [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID 'e35e8fe9-8b00-4f5b-8139-125534feca3f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 619.963255] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 619.963394] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-b41dafbc-cb1f-4d6e-ada2-272d5eff264b tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 621.445437] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Starting to schedule for instances: ['e23659a8-357e-48f6-80a0-dda80fb760d4'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 621.445642] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 621.445642] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.445887] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.446014] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.446185] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 621.494832] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.495072] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.495235] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.502767] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.502978] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.503183] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.505108] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.505318] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.505688] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 621.505981] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 621.506151] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 621.506306] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 621.506470] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.506727] nova-scheduler[52224]: DEBUG nova.filters [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 621.506932] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 79.404852 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 621.507086] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 621.507242] nova-scheduler[52224]: INFO nova.filters [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Filter ComputeFilter returned 0 hosts [ 621.507405] nova-scheduler[52224]: DEBUG nova.filters [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Filtering removed all hosts for the request with instance ID 'e23659a8-357e-48f6-80a0-dda80fb760d4'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 621.507538] nova-scheduler[52224]: INFO nova.filters [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Filtering removed all hosts for the request with instance ID 'e23659a8-357e-48f6-80a0-dda80fb760d4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 621.507679] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 621.507816] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-296d8d6f-3969-4ab2-a46f-3809edd8a637 tempest-ServersV294TestFqdnHostnames-1843251106 tempest-ServersV294TestFqdnHostnames-1843251106-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 622.085778] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Starting to schedule for instances: ['ada4805c-dc94-4595-b46c-c0c4e5971b17'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 622.086080] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 622.086231] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.086406] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.086590] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.086760] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 622.140043] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.140284] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.140449] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.148340] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.148552] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.148715] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.151193] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.151392] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.151753] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 622.152045] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 622.152217] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 622.152372] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 622.152571] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.152780] nova-scheduler[52226]: DEBUG nova.filters [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 622.152985] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 80.050901 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 622.153161] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 622.153529] nova-scheduler[52226]: INFO nova.filters [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Filter ComputeFilter returned 0 hosts [ 622.153529] nova-scheduler[52226]: DEBUG nova.filters [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Filtering removed all hosts for the request with instance ID 'ada4805c-dc94-4595-b46c-c0c4e5971b17'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 622.153650] nova-scheduler[52226]: INFO nova.filters [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Filtering removed all hosts for the request with instance ID 'ada4805c-dc94-4595-b46c-c0c4e5971b17'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 622.153779] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 622.153920] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-057ce5aa-63ed-4e4b-9abc-b908efc231a2 tempest-ServersAdmin275Test-877307732 tempest-ServersAdmin275Test-877307732-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 622.384947] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Starting to schedule for instances: ['10dfcc6e-58c8-456e-8ba8-7b6ac8e8c434'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 622.385248] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 622.385404] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.385576] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.386282] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.386550] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 622.436889] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.437237] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.437465] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.445114] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.445384] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.445605] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.447618] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.447892] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.448391] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 622.448841] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 622.449146] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 622.449436] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 622.449823] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.450230] nova-scheduler[52224]: DEBUG nova.filters [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 622.450537] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 80.3484 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 622.450771] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 622.451022] nova-scheduler[52224]: INFO nova.filters [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filter ComputeFilter returned 0 hosts [ 622.451222] nova-scheduler[52224]: DEBUG nova.filters [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filtering removed all hosts for the request with instance ID '10dfcc6e-58c8-456e-8ba8-7b6ac8e8c434'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 622.451554] nova-scheduler[52224]: INFO nova.filters [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filtering removed all hosts for the request with instance ID '10dfcc6e-58c8-456e-8ba8-7b6ac8e8c434'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 622.452171] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 622.452386] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3b2ad43a-b05a-4ed5-aca9-ec3183af6360 tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 622.581216] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['9a299654-d18a-44d0-b012-c3881d583b49'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 622.581577] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 622.581677] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.581859] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.582051] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.582229] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 622.643487] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.643724] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.643891] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.657658] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.657884] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.658046] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.666951] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.667573] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.667662] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 622.667878] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 622.668091] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 622.668218] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 622.668383] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.668655] nova-scheduler[52226]: DEBUG nova.filters [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 622.668871] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 80.566787 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 622.669024] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 622.669174] nova-scheduler[52226]: INFO nova.filters [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 0 hosts [ 622.669322] nova-scheduler[52226]: DEBUG nova.filters [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID '9a299654-d18a-44d0-b012-c3881d583b49'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 622.669494] nova-scheduler[52226]: INFO nova.filters [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID '9a299654-d18a-44d0-b012-c3881d583b49'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 622.669645] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 622.669787] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8877132b-e1c5-438f-b814-0f0a48b6c11f tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 624.066019] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Starting to schedule for instances: ['5f99f851-a52f-49d0-84b8-3fac55ee94df'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 624.066345] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 624.066491] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.066695] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.066862] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.068530] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 624.112921] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.113158] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.113328] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.121623] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.121623] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.121623] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.124077] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.124278] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.124648] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 624.124926] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 624.125086] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 624.125233] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 624.125388] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.125660] nova-scheduler[52224]: DEBUG nova.filters [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 624.125992] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 82.023785 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 624.126134] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 624.126168] nova-scheduler[52224]: INFO nova.filters [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filter ComputeFilter returned 0 hosts [ 624.126430] nova-scheduler[52224]: DEBUG nova.filters [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filtering removed all hosts for the request with instance ID '5f99f851-a52f-49d0-84b8-3fac55ee94df'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 624.126430] nova-scheduler[52224]: INFO nova.filters [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filtering removed all hosts for the request with instance ID '5f99f851-a52f-49d0-84b8-3fac55ee94df'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 624.126565] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 624.126692] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-eaccba6f-8add-4009-a172-980ca610f40a tempest-ServerShowV247Test-155059694 tempest-ServerShowV247Test-155059694-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 627.483940] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting to schedule for instances: ['5bc87b65-3f26-431c-9231-9d4b2ab9ae99'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.483940] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.483940] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.483940] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.483940] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.483940] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.531760] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.531812] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.531968] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.541793] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.541849] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.541997] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.545129] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.545321] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.545686] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.545985] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.546152] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.546302] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.546459] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.546707] nova-scheduler[52226]: DEBUG nova.filters [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.546902] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 85.444831 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 627.547050] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 627.547191] nova-scheduler[52226]: INFO nova.filters [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filter ComputeFilter returned 0 hosts [ 627.547338] nova-scheduler[52226]: DEBUG nova.filters [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtering removed all hosts for the request with instance ID '5bc87b65-3f26-431c-9231-9d4b2ab9ae99'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 627.547472] nova-scheduler[52226]: INFO nova.filters [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtering removed all hosts for the request with instance ID '5bc87b65-3f26-431c-9231-9d4b2ab9ae99'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 627.547611] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.547749] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-52d2ad77-da44-4609-a9af-4e72d8b75d9a tempest-ImagesTestJSON-881642725 tempest-ImagesTestJSON-881642725-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 628.750882] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting to schedule for instances: ['332a2f07-93be-4210-8009-b8af0c699a5b'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 628.751226] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 628.751331] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 628.751514] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 628.751725] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 628.752052] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 628.804566] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.804566] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.804566] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.818504] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.818553] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.818743] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.824898] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 628.825102] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 628.825473] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 628.825759] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 628.825921] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 628.826069] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 628.826228] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 628.826486] nova-scheduler[52224]: DEBUG nova.filters [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 628.826687] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 86.724611 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 628.826837] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 628.826983] nova-scheduler[52224]: INFO nova.filters [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ComputeFilter returned 0 hosts [ 628.827125] nova-scheduler[52224]: DEBUG nova.filters [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID '332a2f07-93be-4210-8009-b8af0c699a5b'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 628.829558] nova-scheduler[52224]: INFO nova.filters [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID '332a2f07-93be-4210-8009-b8af0c699a5b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 628.829761] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 628.829917] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-f7860274-8884-485a-a689-011d11e306eb tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 634.019537] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Starting to schedule for instances: ['2a343226-558a-4e09-8da8-aac538c812e8'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 634.019537] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 634.019537] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.019537] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.019537] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.019537] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 634.088444] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.088444] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.088624] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.098546] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.098768] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.098930] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.101022] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.101399] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.101574] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 634.101912] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Update host state with aggregates: [Aggregate(created_at=2024-07-30T07:03:03Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-2044716045',updated_at=None,uuid=56dc0594-f55d-4ad4-8d3f-2404928f94f7)] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 634.102088] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 634.102242] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 634.102402] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.102660] nova-scheduler[52226]: DEBUG nova.filters [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 634.102984] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 92.000783 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 634.103061] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 634.103149] nova-scheduler[52226]: INFO nova.filters [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Filter ComputeFilter returned 0 hosts [ 634.103327] nova-scheduler[52226]: DEBUG nova.filters [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Filtering removed all hosts for the request with instance ID '2a343226-558a-4e09-8da8-aac538c812e8'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 634.103531] nova-scheduler[52226]: INFO nova.filters [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Filtering removed all hosts for the request with instance ID '2a343226-558a-4e09-8da8-aac538c812e8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 634.103604] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 634.104839] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-6cf78679-4b65-45c1-8472-1cf0cb802991 tempest-ServersAaction247Test-1374190324 tempest-ServersAaction247Test-1374190324-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 634.243889] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['8842193e-1317-4742-94ee-a9782a7e7091'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 634.244173] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 634.244294] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.244483] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.244675] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.244851] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 634.301804] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.302122] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.302298] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.309334] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.309638] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.309862] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.312493] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.312734] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.313148] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 634.313538] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [Aggregate(created_at=2024-07-30T07:03:03Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-2044716045',updated_at=None,uuid=56dc0594-f55d-4ad4-8d3f-2404928f94f7)] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 634.313760] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 634.313955] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 634.314190] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.314453] nova-scheduler[52224]: DEBUG nova.filters [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 634.314702] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 92.212603 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 634.314895] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 634.315087] nova-scheduler[52224]: INFO nova.filters [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 0 hosts [ 634.315265] nova-scheduler[52224]: DEBUG nova.filters [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID '8842193e-1317-4742-94ee-a9782a7e7091'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 634.315435] nova-scheduler[52224]: INFO nova.filters [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID '8842193e-1317-4742-94ee-a9782a7e7091'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 634.315615] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 634.320303] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-ee2ffe9b-0ca5-4f0e-9d2c-a8ac3a2c1f74 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 635.852434] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Starting to schedule for instances: ['00c13d48-d74c-405c-9517-71363cb93c2e'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 635.852746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 635.852969] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.853074] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.853263] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.853447] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 635.909315] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.909600] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.909774] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.920891] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.921118] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.921267] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.923512] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.923711] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.926134] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 635.926134] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 635.926134] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 635.926134] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 635.926134] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.926134] nova-scheduler[52226]: DEBUG nova.filters [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 635.926134] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 93.823255 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 635.926134] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 635.926568] nova-scheduler[52226]: INFO nova.filters [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Filter ComputeFilter returned 0 hosts [ 635.926568] nova-scheduler[52226]: DEBUG nova.filters [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Filtering removed all hosts for the request with instance ID '00c13d48-d74c-405c-9517-71363cb93c2e'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 635.926568] nova-scheduler[52226]: INFO nova.filters [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Filtering removed all hosts for the request with instance ID '00c13d48-d74c-405c-9517-71363cb93c2e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 635.926568] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 635.926568] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c8516b90-a8df-4fd4-b660-1d6b090042c6 tempest-ServerShowV257Test-1952468431 tempest-ServerShowV257Test-1952468431-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 637.896220] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Starting to schedule for instances: ['9dc752af-5ddf-4938-87ed-c1da08931e8d', '7371342c-9631-4bb3-81a1-25a5a913ef1e', '4129b909-9261-42f4-b21a-ba87ed1e431e'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 637.896511] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 637.896688] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.896887] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.897093] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 637.897285] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 637.945976] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.945976] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.945976] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.952537] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.952740] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.952912] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.954999] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 637.955193] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 637.955558] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 637.955833] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 637.955999] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 637.956163] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 637.956319] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 637.956571] nova-scheduler[52224]: DEBUG nova.filters [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 637.956769] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 95.854692 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 637.956920] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 637.957068] nova-scheduler[52224]: INFO nova.filters [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Filter ComputeFilter returned 0 hosts [ 637.957270] nova-scheduler[52224]: DEBUG nova.filters [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Filtering removed all hosts for the request with instance ID '9dc752af-5ddf-4938-87ed-c1da08931e8d'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 637.957458] nova-scheduler[52224]: INFO nova.filters [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Filtering removed all hosts for the request with instance ID '9dc752af-5ddf-4938-87ed-c1da08931e8d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 637.957617] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 637.957759] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-077c0673-bfc7-4ddc-9564-4bfbe8ec164f tempest-ListServersNegativeTestJSON-1711340119 tempest-ListServersNegativeTestJSON-1711340119-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 638.351561] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Starting to schedule for instances: ['09c28a7d-e77d-4151-8818-93f809ff1c27'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 638.351836] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 638.351997] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.352191] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.352385] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.352563] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 638.418399] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.418615] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.418779] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.426282] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.426505] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.426669] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.428938] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.429487] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.430029] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 638.430376] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 638.430611] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 638.430814] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 638.431020] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.431356] nova-scheduler[52226]: DEBUG nova.filters [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 638.431528] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 96.329443 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 638.431771] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 638.431906] nova-scheduler[52226]: INFO nova.filters [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter ComputeFilter returned 0 hosts [ 638.432121] nova-scheduler[52226]: DEBUG nova.filters [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filtering removed all hosts for the request with instance ID '09c28a7d-e77d-4151-8818-93f809ff1c27'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 638.432360] nova-scheduler[52226]: INFO nova.filters [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filtering removed all hosts for the request with instance ID '09c28a7d-e77d-4151-8818-93f809ff1c27'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 638.432573] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 638.432745] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-62fc3ae5-9d76-4a90-a62d-cad689f83d08 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 642.626758] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting to schedule for instances: ['5e0a102e-0a50-4f4e-a73f-fe6e2539b420'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 642.627033] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 642.627247] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.627392] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.627601] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.627786] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 642.678285] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.678285] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.678285] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.688635] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.688703] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.689197] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.691609] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.692026] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.695170] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 642.695170] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 642.695170] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 642.695170] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 642.695170] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.695170] nova-scheduler[52224]: DEBUG nova.filters [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 642.695170] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 100.591886 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 642.695170] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 642.696640] nova-scheduler[52224]: INFO nova.filters [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filter ComputeFilter returned 0 hosts [ 642.696640] nova-scheduler[52224]: DEBUG nova.filters [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID '5e0a102e-0a50-4f4e-a73f-fe6e2539b420'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 642.696640] nova-scheduler[52224]: INFO nova.filters [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtering removed all hosts for the request with instance ID '5e0a102e-0a50-4f4e-a73f-fe6e2539b420'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 642.696640] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 642.696640] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-ffec48fa-035b-40dd-beaf-915377f7383d tempest-ServerDiskConfigTestJSON-132679284 tempest-ServerDiskConfigTestJSON-132679284-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 642.975238] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Starting to schedule for instances: ['68c2288e-1f96-4b9d-bc31-3707c7eaafb6'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 642.975572] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 642.975730] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.975899] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.976128] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.976312] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 643.031176] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 643.031790] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 643.032164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 643.041467] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 643.041678] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 643.041842] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 643.044063] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 643.044287] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 643.044663] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 643.044947] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 643.045110] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 643.045259] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 643.045429] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 643.045701] nova-scheduler[52226]: DEBUG nova.filters [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 643.046094] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 100.943826 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 643.046308] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 643.046458] nova-scheduler[52226]: INFO nova.filters [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Filter ComputeFilter returned 0 hosts [ 643.046603] nova-scheduler[52226]: DEBUG nova.filters [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Filtering removed all hosts for the request with instance ID '68c2288e-1f96-4b9d-bc31-3707c7eaafb6'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 643.046736] nova-scheduler[52226]: INFO nova.filters [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Filtering removed all hosts for the request with instance ID '68c2288e-1f96-4b9d-bc31-3707c7eaafb6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 643.046875] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 643.047016] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-29f949e9-20c7-4ad0-ad89-b50928f09fb3 tempest-ServerShowV254Test-223714071 tempest-ServerShowV254Test-223714071-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 647.917987] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Starting to schedule for instances: ['bee5095d-8fc3-43ed-be44-2b9f8926f1b1'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 647.917987] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 647.918234] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.918279] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.919631] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.919631] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 647.965792] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.965970] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.966615] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.978144] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.978144] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.978144] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.979897] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.980108] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.980502] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 647.980796] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 647.980959] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 647.981108] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 647.981265] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.981699] nova-scheduler[52224]: DEBUG nova.filters [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 647.981851] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 105.879644 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 647.981975] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 647.982047] nova-scheduler[52224]: INFO nova.filters [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ComputeFilter returned 0 hosts [ 647.982282] nova-scheduler[52224]: DEBUG nova.filters [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtering removed all hosts for the request with instance ID 'bee5095d-8fc3-43ed-be44-2b9f8926f1b1'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 647.982456] nova-scheduler[52224]: INFO nova.filters [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtering removed all hosts for the request with instance ID 'bee5095d-8fc3-43ed-be44-2b9f8926f1b1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 647.982456] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 647.984172] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-fa5bb873-4076-47ba-82fd-ff936c059e2d tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 650.035337] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['625631eb-bca8-4039-a727-66dbf75f83f5'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 650.035618] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 650.035774] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.035944] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.036155] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.036328] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 650.102195] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.102431] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.102604] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.116260] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.116476] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.116831] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.118941] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.119152] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.119630] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 650.119877] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 650.120062] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 650.120213] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 650.120416] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.120974] nova-scheduler[52226]: DEBUG nova.filters [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 650.121183] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 108.019099 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 650.121334] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 650.121477] nova-scheduler[52226]: INFO nova.filters [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 0 hosts [ 650.121614] nova-scheduler[52226]: DEBUG nova.filters [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID '625631eb-bca8-4039-a727-66dbf75f83f5'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 650.121784] nova-scheduler[52226]: INFO nova.filters [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtering removed all hosts for the request with instance ID '625631eb-bca8-4039-a727-66dbf75f83f5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 650.121928] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 650.122071] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-abff987d-ee36-4001-b4d8-e2f27e23beaf tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 652.862841] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Starting to schedule for instances: ['28aad5a6-8c5b-4c17-9447-54271e5406a1'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 652.863402] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 652.863640] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.863755] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.863947] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.864147] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 652.921945] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.922186] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.922357] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.930649] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.930862] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.931023] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.933330] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.933535] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.933881] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='13',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_1530d7659b4542e4ad51d6441f8e7233='0',num_proj_2c440d3c841b4cce9d002df5bfd0d3e3='0',num_proj_3ff909bdf0ad4132958081b4a8e2db57='0',num_proj_51493b6ed2374b22917040c9b376791e='0',num_proj_59f74bb6dc524b91ba810698b0d426bc='0',num_proj_8cef493bd04c4774a966a9ab88a664de='0',num_proj_be85dc9c869c411abd04f48acdca9d13='0',num_proj_fe93513973214329b9bf2cb4f49b6e22='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:02:43Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 652.934155] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 652.934348] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 652.934508] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 652.934666] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.934921] nova-scheduler[52224]: DEBUG nova.filters [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 652.935119] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 110.833045 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 652.935266] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 652.935407] nova-scheduler[52224]: INFO nova.filters [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Filter ComputeFilter returned 0 hosts [ 652.935583] nova-scheduler[52224]: DEBUG nova.filters [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Filtering removed all hosts for the request with instance ID '28aad5a6-8c5b-4c17-9447-54271e5406a1'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 652.935735] nova-scheduler[52224]: INFO nova.filters [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Filtering removed all hosts for the request with instance ID '28aad5a6-8c5b-4c17-9447-54271e5406a1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 652.935878] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 652.936030] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-3cf4adb6-6899-4994-950f-aa445f3574bf tempest-ImagesOneServerNegativeTestJSON-1259788042 tempest-ImagesOneServerNegativeTestJSON-1259788042-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 653.784599] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.784599] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.784866] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.784968] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.785004] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.785049] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.785903] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.786088] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.786088] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.786088] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.788624] nova-scheduler[52226]: INFO nova.scheduler.host_manager [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 653.788800] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.789581] nova-scheduler[52224]: INFO nova.scheduler.host_manager [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 653.789859] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e6d8f255-17e2-4020-9e29-18d7b52dfe59 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.079601] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Starting to schedule for instances: ['be286aee-231e-4b00-a447-1f348407790c'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 655.079885] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 655.080057] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.080246] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.080445] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.080643] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 655.130861] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.131096] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.131259] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.141545] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.141763] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.141922] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.144169] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.144374] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.144737] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 655.145027] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 655.145187] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 655.145337] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 655.145498] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.145767] nova-scheduler[52226]: DEBUG nova.filters [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 655.146123] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 113.044015 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 655.146278] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 655.146427] nova-scheduler[52226]: INFO nova.filters [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filter ComputeFilter returned 0 hosts [ 655.146571] nova-scheduler[52226]: DEBUG nova.filters [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filtering removed all hosts for the request with instance ID 'be286aee-231e-4b00-a447-1f348407790c'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 655.146702] nova-scheduler[52226]: INFO nova.filters [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filtering removed all hosts for the request with instance ID 'be286aee-231e-4b00-a447-1f348407790c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 655.146842] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 655.146995] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f1426a83-31e2-43d3-91f0-eb96ad6526c9 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 656.788130] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Starting to schedule for instances: ['a1976a15-1844-419a-ade3-691313460418'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 656.801690] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 656.801690] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.801690] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.801690] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.801690] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 656.841320] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.841550] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.841728] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.848416] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.848678] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.848992] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.855607] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.855607] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.855607] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 656.855607] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 656.855607] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 656.855607] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 656.855607] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.859108] nova-scheduler[52224]: DEBUG nova.filters [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 656.859108] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 114.756955 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 656.859407] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 656.859657] nova-scheduler[52224]: INFO nova.filters [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Filter ComputeFilter returned 0 hosts [ 656.863388] nova-scheduler[52224]: DEBUG nova.filters [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Filtering removed all hosts for the request with instance ID 'a1976a15-1844-419a-ade3-691313460418'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 656.863388] nova-scheduler[52224]: INFO nova.filters [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Filtering removed all hosts for the request with instance ID 'a1976a15-1844-419a-ade3-691313460418'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 656.863388] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 656.863388] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-34d99325-f353-481a-be12-0af5a3778946 tempest-ServerAddressesTestJSON-1830910305 tempest-ServerAddressesTestJSON-1830910305-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 656.866328] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Starting to schedule for instances: ['3e49ef09-1a84-41c0-822a-3212909c2d24'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 656.866456] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 656.866898] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.866898] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.868258] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.868698] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 656.956361] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.956361] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.956361] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.961908] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.965146] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.965146] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.965146] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.965146] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.965146] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 656.965146] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 656.965444] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 656.965444] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 656.968272] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.968272] nova-scheduler[52226]: DEBUG nova.filters [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 656.968272] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 114.864012 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 656.968272] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 656.968272] nova-scheduler[52226]: INFO nova.filters [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Filter ComputeFilter returned 0 hosts [ 656.968272] nova-scheduler[52226]: DEBUG nova.filters [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Filtering removed all hosts for the request with instance ID '3e49ef09-1a84-41c0-822a-3212909c2d24'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 656.968272] nova-scheduler[52226]: INFO nova.filters [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Filtering removed all hosts for the request with instance ID '3e49ef09-1a84-41c0-822a-3212909c2d24'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 656.968272] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 656.968272] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-de65c8ff-4e8e-4c85-af73-5e3f16aa2be3 tempest-ServerExternalEventsTest-1472496492 tempest-ServerExternalEventsTest-1472496492-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 658.670813] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Starting to schedule for instances: ['950430bd-7dac-404f-83d9-724f1b77de7c'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 658.670813] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 658.670813] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.670813] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.670813] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.670813] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 658.722675] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.723287] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.723287] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.729881] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.730130] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.730703] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.732170] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.732364] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.732707] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 658.732983] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 658.733146] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 658.733292] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 658.733460] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.733715] nova-scheduler[52224]: DEBUG nova.filters [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 658.733917] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 116.631842 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 658.734068] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 658.734212] nova-scheduler[52224]: INFO nova.filters [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Filter ComputeFilter returned 0 hosts [ 658.734353] nova-scheduler[52224]: DEBUG nova.filters [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Filtering removed all hosts for the request with instance ID '950430bd-7dac-404f-83d9-724f1b77de7c'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 658.734525] nova-scheduler[52224]: INFO nova.filters [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Filtering removed all hosts for the request with instance ID '950430bd-7dac-404f-83d9-724f1b77de7c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 658.734658] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 658.735572] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-4ef62fb5-adc3-4b48-9ca9-461c3241a151 tempest-ServerActionsTestJSON-425417977 tempest-ServerActionsTestJSON-425417977-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 658.881928] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Starting to schedule for instances: ['be1987e1-79d1-4b2b-a894-18906537bcb4'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 658.882254] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 658.882410] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.882631] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.882832] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.883009] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 658.943580] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.943815] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.943981] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.950194] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.950403] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.950563] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.956458] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.956695] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.957175] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 658.957497] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 658.957640] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 658.957794] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 658.957958] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.958219] nova-scheduler[52226]: DEBUG nova.filters [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 658.958430] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 116.856347 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 658.958588] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 658.958739] nova-scheduler[52226]: INFO nova.filters [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filter ComputeFilter returned 0 hosts [ 658.958881] nova-scheduler[52226]: DEBUG nova.filters [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filtering removed all hosts for the request with instance ID 'be1987e1-79d1-4b2b-a894-18906537bcb4'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 658.959017] nova-scheduler[52226]: INFO nova.filters [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filtering removed all hosts for the request with instance ID 'be1987e1-79d1-4b2b-a894-18906537bcb4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 658.959155] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 658.959299] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-82141150-73d2-4804-a1a8-bcc55bf347d7 tempest-ServersAdminTestJSON-1872066989 tempest-ServersAdminTestJSON-1872066989-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.769952] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Starting to schedule for instances: ['29afb100-10c4-4b61-b963-379bc762c1e4'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.770228] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.770407] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.770600] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.770803] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.770980] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.840434] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.840434] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.840434] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.847562] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.847983] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.848302] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.851735] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.852226] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.853070] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.853500] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.853911] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.854301] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.854615] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.855028] nova-scheduler[52224]: DEBUG nova.filters [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.855422] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 118.753257 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.855812] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 660.856294] nova-scheduler[52224]: INFO nova.filters [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Filter ComputeFilter returned 0 hosts [ 660.856578] nova-scheduler[52224]: DEBUG nova.filters [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Filtering removed all hosts for the request with instance ID '29afb100-10c4-4b61-b963-379bc762c1e4'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.856919] nova-scheduler[52224]: INFO nova.filters [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Filtering removed all hosts for the request with instance ID '29afb100-10c4-4b61-b963-379bc762c1e4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.857291] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.857605] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-2a93d849-f108-4f7b-b345-f02c4efbd4bd tempest-ImagesOneServerTestJSON-552519743 tempest-ImagesOneServerTestJSON-552519743-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 661.486290] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Starting to schedule for instances: ['091994e0-25a6-4b61-8bdb-e852970464ba'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 661.486683] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 661.486746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.486923] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.487128] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.487301] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 661.537617] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.537839] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.538000] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.545303] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.545505] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.545665] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.548172] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.548363] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.548712] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 661.548993] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 661.549158] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 661.549319] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 661.549486] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.549739] nova-scheduler[52226]: DEBUG nova.filters [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 661.549955] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 119.447873 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 661.550103] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 661.550246] nova-scheduler[52226]: INFO nova.filters [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Filter ComputeFilter returned 0 hosts [ 661.550410] nova-scheduler[52226]: DEBUG nova.filters [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Filtering removed all hosts for the request with instance ID '091994e0-25a6-4b61-8bdb-e852970464ba'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 661.550550] nova-scheduler[52226]: INFO nova.filters [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Filtering removed all hosts for the request with instance ID '091994e0-25a6-4b61-8bdb-e852970464ba'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 661.550694] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 661.550833] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-17700f35-c4f5-4e7e-82c3-f7edeede136d tempest-ServerRescueTestJSONUnderV235-677208041 tempest-ServerRescueTestJSONUnderV235-677208041-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 662.088221] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Starting to schedule for instances: ['cdc7fd29-e314-4a66-808c-ff951f8a1690'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 662.088548] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 662.088714] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.088892] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.089102] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.089324] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 662.136698] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.136988] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.137070] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.145130] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.145646] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.146287] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.149607] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.150029] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.150586] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 662.151118] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 662.151420] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 1, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 662.152362] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 662.152909] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.153413] nova-scheduler[52224]: DEBUG nova.filters [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 662.153797] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:01:36. Elapsed time is 120.051677 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 662.154536] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 662.154836] nova-scheduler[52224]: INFO nova.filters [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Filter ComputeFilter returned 0 hosts [ 662.155187] nova-scheduler[52224]: DEBUG nova.filters [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Filtering removed all hosts for the request with instance ID 'cdc7fd29-e314-4a66-808c-ff951f8a1690'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 662.155477] nova-scheduler[52224]: INFO nova.filters [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Filtering removed all hosts for the request with instance ID 'cdc7fd29-e314-4a66-808c-ff951f8a1690'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 662.156356] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 662.156892] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-92cfd30a-cec2-48d4-a2ad-227389367a24 tempest-ServersTestFqdnHostnames-192877029 tempest-ServersTestFqdnHostnames-192877029-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 662.936234] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Starting to schedule for instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 662.936234] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 662.936234] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.936234] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.936234] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 662.936234] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 662.982318] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.982318] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.982318] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.987910] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.988252] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.988597] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.990672] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 662.991086] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 662.991557] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='15'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 662.991991] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 662.992352] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 662.992624] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 662.993100] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 662.993513] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 662.993826] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.994106] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.994395] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.994654] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.994912] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.995181] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.995486] nova-scheduler[52226]: DEBUG nova.filters [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 662.995738] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 662.996012] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 662.996319] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Attempting to claim resources in the placement API for instance 79e866be-bbea-4147-9ad7-1aab629da4bd {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 663.051796] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] [instance: 79e866be-bbea-4147-9ad7-1aab629da4bd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 663.052535] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.052921] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.053245] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a3dc2aa7-f5f0-4baa-a624-55beb8382676 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.585118] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Starting to schedule for instances: ['15f8affc-42a5-433f-bd17-ac6df7b9f4ea'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 663.585358] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 663.590166] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 663.590166] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 663.590166] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 663.590166] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 663.640057] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.640364] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.640595] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.652790] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.653071] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.653278] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.656070] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.656070] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.656070] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='15',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:37Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=1) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 663.656452] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 663.656848] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 663.656848] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 663.657026] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.657342] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 663.657684] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.657927] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.658395] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.658395] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.658589] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.658815] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.659021] nova-scheduler[52224]: DEBUG nova.filters [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 663.659217] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 663.659445] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 663.659665] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Attempting to claim resources in the placement API for instance 15f8affc-42a5-433f-bd17-ac6df7b9f4ea {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 663.715923] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] [instance: 15f8affc-42a5-433f-bd17-ac6df7b9f4ea] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 663.716286] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.716500] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.716723] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-08191194-b93a-4bf5-82c6-7a32a250d686 tempest-InstanceActionsTestJSON-2017199602 tempest-InstanceActionsTestJSON-2017199602-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.629468] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting to schedule for instances: ['165edd1e-7271-490d-abfe-1d66617ce612', '4a8049b5-9aac-4c49-a391-0f8ee0e22c2b'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 664.629951] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 664.629951] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.630119] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.630313] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.630516] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 664.674771] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.674995] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.675161] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.690592] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.691088] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.691495] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.693684] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.693949] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.694337] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='15',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:37Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=2) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 664.694684] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 664.694879] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 664.695039] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd', '15f8affc-42a5-433f-bd17-ac6df7b9f4ea'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 664.695282] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.695625] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.696386] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.696386] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.696386] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.696495] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.696585] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.696747] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.697325] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.697579] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.697794] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 664.698351] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Attempting to claim resources in the placement API for instance 165edd1e-7271-490d-abfe-1d66617ce612 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 664.766934] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] [instance: 165edd1e-7271-490d-abfe-1d66617ce612] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 664.767283] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.767603] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.767812] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.768060] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.768270] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.768440] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.768595] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.768761] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 664.768933] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Attempting to claim resources in the placement API for instance 4a8049b5-9aac-4c49-a391-0f8ee0e22c2b {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 664.822588] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] [instance: 4a8049b5-9aac-4c49-a391-0f8ee0e22c2b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 664.822892] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.823098] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.823297] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.823482] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.823803] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.823882] nova-scheduler[52226]: DEBUG nova.filters [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 664.824050] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.824222] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-70c132b5-762e-4d28-a161-40989c0f4725 tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 665.364671] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Starting to schedule for instances: ['9f881f30-cf78-42de-bde5-e0c010c0012b'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 665.364671] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 665.364671] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.364671] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.364671] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.364671] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 665.407270] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.407555] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.407690] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.415057] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.415057] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.415138] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.419357] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.419677] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.419983] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='15',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:39Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 665.420310] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 665.420475] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 665.420624] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd', '15f8affc-42a5-433f-bd17-ac6df7b9f4ea', '165edd1e-7271-490d-abfe-1d66617ce612', '4a8049b5-9aac-4c49-a391-0f8ee0e22c2b'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 665.420785] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.421034] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 665.421255] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.421417] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.421612] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.421965] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.421965] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.422093] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.422235] nova-scheduler[52224]: DEBUG nova.filters [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 665.422435] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 665.422634] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 665.422777] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Attempting to claim resources in the placement API for instance 9f881f30-cf78-42de-bde5-e0c010c0012b {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 665.507024] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] [instance: 9f881f30-cf78-42de-bde5-e0c010c0012b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 665.507024] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.507024] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.507024] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9b97726d-1260-45cd-ab98-d86d8196b668 tempest-AttachInterfacesUnderV243Test-255513625 tempest-AttachInterfacesUnderV243Test-255513625-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.482006] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['40ef854e-8fc0-4854-a9a7-51cbb3744cf6'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 666.482264] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 666.482418] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.482590] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.482805] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.482951] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 666.540293] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.540563] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.540736] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.547429] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.547688] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.547889] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.553320] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.553535] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.553963] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='15',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_83fc016eb04e424483fda0e1ec856d1b='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:39Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 666.554203] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 666.554376] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 666.554533] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd', '15f8affc-42a5-433f-bd17-ac6df7b9f4ea', '165edd1e-7271-490d-abfe-1d66617ce612', '4a8049b5-9aac-4c49-a391-0f8ee0e22c2b', '9f881f30-cf78-42de-bde5-e0c010c0012b'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 666.554692] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.554948] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 666.555154] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.555345] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.555528] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.555823] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.555823] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.555984] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.556178] nova-scheduler[52226]: DEBUG nova.filters [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 666.556340] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 666.556508] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 666.556710] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Attempting to claim resources in the placement API for instance 40ef854e-8fc0-4854-a9a7-51cbb3744cf6 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 666.614444] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] [instance: 40ef854e-8fc0-4854-a9a7-51cbb3744cf6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 666.614769] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.614973] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.615182] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2471eb69-41d4-4346-8257-6372cc7e03ed tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.843291] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Starting to schedule for instances: ['8dd23ab3-910a-4ffc-946b-65d469f650e5'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 669.843583] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 669.843746] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.843918] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.844353] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.844353] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 669.890076] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.890300] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.890462] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.899142] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.899361] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.899555] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.901663] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.901974] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.902353] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='15',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_83fc016eb04e424483fda0e1ec856d1b='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:40Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=6) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 669.902678] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 669.902894] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 669.903006] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd', '15f8affc-42a5-433f-bd17-ac6df7b9f4ea', '165edd1e-7271-490d-abfe-1d66617ce612', '4a8049b5-9aac-4c49-a391-0f8ee0e22c2b', '9f881f30-cf78-42de-bde5-e0c010c0012b', '40ef854e-8fc0-4854-a9a7-51cbb3744cf6'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 669.903164] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.903441] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 669.903848] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.904118] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.904326] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.904492] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.904655] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.904822] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.904981] nova-scheduler[52224]: DEBUG nova.filters [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 669.905136] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 669.905303] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 669.905474] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Attempting to claim resources in the placement API for instance 8dd23ab3-910a-4ffc-946b-65d469f650e5 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 669.956299] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] [instance: 8dd23ab3-910a-4ffc-946b-65d469f650e5] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 669.956632] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.956922] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.957137] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-870ff474-b83e-461b-8a45-e1d3f72646e3 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.725656] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Starting to schedule for instances: ['d724e6f8-372c-4f43-8531-08e45600602e'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 670.725944] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 670.726115] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.726323] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.726527] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.726709] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 670.785205] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.785428] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.785597] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.792687] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.792891] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.793055] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.795532] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.795611] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.800313] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='15',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_83fc016eb04e424483fda0e1ec856d1b='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:44Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=7) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 670.800764] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 670.801013] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 670.801117] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd', '15f8affc-42a5-433f-bd17-ac6df7b9f4ea', '165edd1e-7271-490d-abfe-1d66617ce612', '4a8049b5-9aac-4c49-a391-0f8ee0e22c2b', '9f881f30-cf78-42de-bde5-e0c010c0012b', '40ef854e-8fc0-4854-a9a7-51cbb3744cf6', '8dd23ab3-910a-4ffc-946b-65d469f650e5'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 670.801284] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.006s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.801543] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 670.801745] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.801918] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.802146] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.802273] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.802431] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.802589] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.802743] nova-scheduler[52226]: DEBUG nova.filters [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.802896] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 670.803060] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 670.803233] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Attempting to claim resources in the placement API for instance d724e6f8-372c-4f43-8531-08e45600602e {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 670.859483] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] [instance: d724e6f8-372c-4f43-8531-08e45600602e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 670.859811] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.860043] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.860235] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-21dd1891-32a2-4596-8419-f18fba892669 tempest-ServerRescueNegativeTestJSON-687776801 tempest-ServerRescueNegativeTestJSON-687776801-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.751807] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Starting to schedule for instances: ['42e43b92-c67e-4347-8cd4-e2f601520afd'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 674.752151] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 674.752320] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.752496] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.752692] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.752863] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 674.796174] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.796174] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.796174] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.803448] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.803814] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.804105] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.806389] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.806709] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.807223] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='15',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_83fc016eb04e424483fda0e1ec856d1b='1',num_proj_f61427aeee17442ead99ee0494842480='2',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=8) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 674.807671] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 674.807971] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 674.808283] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Update host state with instances: ['79e866be-bbea-4147-9ad7-1aab629da4bd', '15f8affc-42a5-433f-bd17-ac6df7b9f4ea', '165edd1e-7271-490d-abfe-1d66617ce612', '4a8049b5-9aac-4c49-a391-0f8ee0e22c2b', '9f881f30-cf78-42de-bde5-e0c010c0012b', '40ef854e-8fc0-4854-a9a7-51cbb3744cf6', '8dd23ab3-910a-4ffc-946b-65d469f650e5', 'd724e6f8-372c-4f43-8531-08e45600602e'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 674.808573] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.808967] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 674.809269] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.809565] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.809865] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.810130] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.810431] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.810727] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.810991] nova-scheduler[52224]: DEBUG nova.filters [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.811243] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 674.811507] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 674.811795] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Attempting to claim resources in the placement API for instance 42e43b92-c67e-4347-8cd4-e2f601520afd {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 674.873771] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] [instance: 42e43b92-c67e-4347-8cd4-e2f601520afd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 674.874075] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.874322] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.874493] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e172f0c1-a11b-4928-b25b-094c5cd3cc7e tempest-ServerTagsTestJSON-1219086942 tempest-ServerTagsTestJSON-1219086942-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.480131] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Starting to schedule for instances: ['d42d92f1-6539-490f-b9da-c364620b70bb'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 679.480131] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 679.480131] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 679.480131] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 679.480131] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 679.480604] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 679.532058] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.532282] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.532445] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.540524] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.540743] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.540912] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.544406] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.544511] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.544902] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='17',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_035445ac029043e9801da5cf6bc1f7b1='1',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_3bfa2b43dd2b472d81d188daecf70313='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_83fc016eb04e424483fda0e1ec856d1b='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='1',num_proj_f61427aeee17442ead99ee0494842480='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:52Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=6) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 679.545251] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 679.545435] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 679.545628] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with instances: ['15f8affc-42a5-433f-bd17-ac6df7b9f4ea', '9f881f30-cf78-42de-bde5-e0c010c0012b', '8dd23ab3-910a-4ffc-946b-65d469f650e5', 'd724e6f8-372c-4f43-8531-08e45600602e', '42e43b92-c67e-4347-8cd4-e2f601520afd'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 679.545822] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.546087] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 679.546289] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.546467] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.546681] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.546824] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.546979] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.547137] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.547291] nova-scheduler[52226]: DEBUG nova.filters [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 679.547448] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 679.548462] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 679.548462] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Attempting to claim resources in the placement API for instance d42d92f1-6539-490f-b9da-c364620b70bb {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 679.602355] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] [instance: d42d92f1-6539-490f-b9da-c364620b70bb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 679.602737] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.603138] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.603263] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-cfbecde1-09fb-4a32-b28a-e1c3572eb7f7 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.456772] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting to schedule for instances: ['05dd2d83-cc57-4dd2-8803-c53b66124080'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 687.457060] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 687.457213] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.457385] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.457575] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.457748] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 687.507291] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.507520] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.507683] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.518730] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.518953] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.519117] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.521964] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.522178] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.522558] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='21',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_3bfa2b43dd2b472d81d188daecf70313='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='1',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:03:57Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 687.523030] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 687.523224] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 687.523383] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Update host state with instances: ['8dd23ab3-910a-4ffc-946b-65d469f650e5', '42e43b92-c67e-4347-8cd4-e2f601520afd', 'd42d92f1-6539-490f-b9da-c364620b70bb'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 687.523544] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.523809] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 687.523998] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.524188] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.524380] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.524542] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.524698] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.524854] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.525023] nova-scheduler[52224]: DEBUG nova.filters [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 687.525162] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 687.525384] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 687.525488] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Attempting to claim resources in the placement API for instance 05dd2d83-cc57-4dd2-8803-c53b66124080 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 687.592676] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] [instance: 05dd2d83-cc57-4dd2-8803-c53b66124080] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 687.592968] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.593176] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.593377] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-1509b46c-2f02-4be9-af1a-3f2483660c48 tempest-ServersTestJSON-1422238213 tempest-ServersTestJSON-1422238213-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.097424] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Starting to schedule for instances: ['97827c0c-ff0a-4d9a-987a-881ee8dd8955'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 690.097753] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 690.097909] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.098080] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.098268] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.098447] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 690.156434] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.156434] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.156434] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.160164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.160387] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.160553] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.162836] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.163883] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.163883] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='22',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:01Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 690.163883] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 690.163883] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 690.164154] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Update host state with instances: ['d42d92f1-6539-490f-b9da-c364620b70bb', '05dd2d83-cc57-4dd2-8803-c53b66124080'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 690.164188] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.164421] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 690.164616] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.164788] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.164974] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.165132] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.165285] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.165440] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.165594] nova-scheduler[52226]: DEBUG nova.filters [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 690.165740] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 690.165939] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 690.166073] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Attempting to claim resources in the placement API for instance 97827c0c-ff0a-4d9a-987a-881ee8dd8955 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 690.214958] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] [instance: 97827c0c-ff0a-4d9a-987a-881ee8dd8955] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 690.215256] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.215462] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.215655] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-e0230078-4e91-4a95-8ee2-15463b548607 tempest-ServerActionsTestOtherB-1317782378 tempest-ServerActionsTestOtherB-1317782378-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.303652] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Starting to schedule for instances: ['3d08ca8c-3ee4-43d5-b151-a56d23915ee1'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 691.303956] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 691.304292] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.304292] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.304747] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.304747] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 691.347036] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.347265] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.347433] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.357809] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.358475] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.358860] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.361593] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.362191] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.363235] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='23',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:04Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 691.363539] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 691.363872] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 691.364019] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Update host state with instances: ['d42d92f1-6539-490f-b9da-c364620b70bb', '05dd2d83-cc57-4dd2-8803-c53b66124080', '97827c0c-ff0a-4d9a-987a-881ee8dd8955'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 691.364180] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.364510] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 691.364742] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.364960] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.365160] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.365658] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.366211] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.366520] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.366987] nova-scheduler[52224]: DEBUG nova.filters [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 691.367162] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 691.367913] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 691.368144] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Attempting to claim resources in the placement API for instance 3d08ca8c-3ee4-43d5-b151-a56d23915ee1 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 691.454105] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] [instance: 3d08ca8c-3ee4-43d5-b151-a56d23915ee1] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 691.454410] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.454618] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.454818] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-5d5e23f9-eac2-4162-8a29-78fef7e15241 tempest-ServerActionsTestOtherA-555994693 tempest-ServerActionsTestOtherA-555994693-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.826721] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting to schedule for instances: ['3cc88caf-d825-41d1-9f49-ad8a54f1a5c2', '22d20f77-3661-4981-944e-350f06e458f6'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 693.827004] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 693.827161] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.827332] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.827539] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.827711] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 693.869657] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.869881] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.870040] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.876409] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.876617] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.876782] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.878782] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.878971] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.879338] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='24',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_ee62738466de4d8caa03f04a86992f63='1',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='0',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:06Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=3) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 693.879654] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 693.879821] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 693.879970] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Update host state with instances: ['05dd2d83-cc57-4dd2-8803-c53b66124080', '97827c0c-ff0a-4d9a-987a-881ee8dd8955', '3d08ca8c-3ee4-43d5-b151-a56d23915ee1'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 693.880142] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.880576] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 693.880648] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.880772] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.880956] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.881114] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.881268] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.881443] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.881577] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.881743] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 693.881917] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 693.882086] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Attempting to claim resources in the placement API for instance 3cc88caf-d825-41d1-9f49-ad8a54f1a5c2 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 693.928188] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] [instance: 3cc88caf-d825-41d1-9f49-ad8a54f1a5c2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 693.928502] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.928714] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.928918] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.929148] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 693.929336] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.929569] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.929727] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 693.929893] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 693.930067] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Attempting to claim resources in the placement API for instance 22d20f77-3661-4981-944e-350f06e458f6 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 693.985242] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] [instance: 22d20f77-3661-4981-944e-350f06e458f6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 693.985555] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.985759] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.985956] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.986139] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 693.986442] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.986509] nova-scheduler[52226]: DEBUG nova.filters [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 693.987439] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 693.987439] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-86d0dd4a-91c6-45f5-81fb-fbb8ab27003c tempest-MultipleCreateTestJSON-1794264911 tempest-MultipleCreateTestJSON-1794264911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 698.031989] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Starting to schedule for instances: ['53c40ff7-aec0-4b5e-b102-6ade1bd1d599'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 698.032317] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 698.032487] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.032659] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.032877] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.033063] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 698.079821] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.080062] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.080236] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.086807] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.087015] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.087180] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.089233] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.089458] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.089851] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='24',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_ee62738466de4d8caa03f04a86992f63='1',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='0',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:08Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 698.090405] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 698.090405] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 698.090535] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state with instances: ['05dd2d83-cc57-4dd2-8803-c53b66124080', '97827c0c-ff0a-4d9a-987a-881ee8dd8955', '3d08ca8c-3ee4-43d5-b151-a56d23915ee1', '3cc88caf-d825-41d1-9f49-ad8a54f1a5c2', '22d20f77-3661-4981-944e-350f06e458f6'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 698.090727] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.090997] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 698.091194] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.091369] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.091561] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.091738] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.091914] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.092127] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.092249] nova-scheduler[52224]: DEBUG nova.filters [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 698.092423] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 698.092598] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 698.092738] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Attempting to claim resources in the placement API for instance 53c40ff7-aec0-4b5e-b102-6ade1bd1d599 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 698.148689] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] [instance: 53c40ff7-aec0-4b5e-b102-6ade1bd1d599] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 698.148995] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.149198] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.149433] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-440c180a-e4ee-4b5a-a2c0-3f439cd8dbe8 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.430746] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Starting to schedule for instances: ['2a5e19fb-ba10-4a9d-91ab-026d1a550229'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 700.430746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 700.430746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.430746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.430746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.430746] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 700.480697] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.480930] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.481097] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.487625] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.487830] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.487991] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.490215] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.490444] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.491304] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='25',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='1',num_proj_ee62738466de4d8caa03f04a86992f63='1',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='0',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:12Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=6) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 700.491722] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 700.491803] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 700.491932] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Update host state with instances: ['05dd2d83-cc57-4dd2-8803-c53b66124080', '97827c0c-ff0a-4d9a-987a-881ee8dd8955', '3d08ca8c-3ee4-43d5-b151-a56d23915ee1', '3cc88caf-d825-41d1-9f49-ad8a54f1a5c2', '22d20f77-3661-4981-944e-350f06e458f6', '53c40ff7-aec0-4b5e-b102-6ade1bd1d599'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 700.494849] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.filters [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 700.494849] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Attempting to claim resources in the placement API for instance 2a5e19fb-ba10-4a9d-91ab-026d1a550229 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 700.568594] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] [instance: 2a5e19fb-ba10-4a9d-91ab-026d1a550229] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 700.568594] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.568594] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.568594] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-8e895023-28ee-46a3-9497-b8319be47b36 tempest-SecurityGroupsTestJSON-1833742006 tempest-SecurityGroupsTestJSON-1833742006-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.560979] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Starting to schedule for instances: ['225ac277-4b75-424e-8055-1b2392647cd9'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 701.561283] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 701.561446] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 701.561627] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 701.561858] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 701.562056] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 701.602756] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.602940] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.603106] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.610196] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.610409] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.610599] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.613123] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.613316] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.613666] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='25',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='1',num_proj_16d31e2b62c74c1083fe347d910d5bc5='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='1',num_proj_ee62738466de4d8caa03f04a86992f63='1',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='0',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:14Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=7) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 701.613938] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 701.614096] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 701.614246] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Update host state with instances: ['05dd2d83-cc57-4dd2-8803-c53b66124080', '97827c0c-ff0a-4d9a-987a-881ee8dd8955', '3d08ca8c-3ee4-43d5-b151-a56d23915ee1', '3cc88caf-d825-41d1-9f49-ad8a54f1a5c2', '22d20f77-3661-4981-944e-350f06e458f6', '53c40ff7-aec0-4b5e-b102-6ade1bd1d599', '2a5e19fb-ba10-4a9d-91ab-026d1a550229'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 701.614412] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 701.614848] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 701.614913] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615320] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615320] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615423] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615533] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615689] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615842] nova-scheduler[52224]: DEBUG nova.filters [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 701.615990] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 701.616504] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 701.616702] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Attempting to claim resources in the placement API for instance 225ac277-4b75-424e-8055-1b2392647cd9 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 701.669007] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] [instance: 225ac277-4b75-424e-8055-1b2392647cd9] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 701.669291] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 701.669517] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 701.669716] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-732a5394-08ed-4a51-82d4-e5ae97fe0479 tempest-ListImageFiltersTestJSON-1650534505 tempest-ListImageFiltersTestJSON-1650534505-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.877765] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Starting to schedule for instances: ['0b7d36fa-1255-45f3-ac5b-ff9dff3621bd'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 708.878426] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 708.878592] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 708.878762] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 708.878949] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 708.879124] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 708.928935] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.929155] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.929315] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.939662] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.939875] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.940050] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.942358] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.942565] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.942967] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='25',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='2',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='1',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='2',num_proj_ee62738466de4d8caa03f04a86992f63='1',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='0',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:18Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=7) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 708.943236] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 708.943449] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 708.943580] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Update host state with instances: ['3d08ca8c-3ee4-43d5-b151-a56d23915ee1', '3cc88caf-d825-41d1-9f49-ad8a54f1a5c2', '22d20f77-3661-4981-944e-350f06e458f6', '53c40ff7-aec0-4b5e-b102-6ade1bd1d599', '2a5e19fb-ba10-4a9d-91ab-026d1a550229', '225ac277-4b75-424e-8055-1b2392647cd9'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 708.943734] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.944055] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 708.944284] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.944462] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.944653] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.944815] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.944973] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.945131] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.945284] nova-scheduler[52226]: DEBUG nova.filters [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.945429] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 708.945909] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 708.946111] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Attempting to claim resources in the placement API for instance 0b7d36fa-1255-45f3-ac5b-ff9dff3621bd {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 709.026004] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] [instance: 0b7d36fa-1255-45f3-ac5b-ff9dff3621bd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 709.026004] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.026004] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.026190] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-fdb05175-d09c-4dfd-9aa5-129849de8cfe tempest-ServersTestManualDisk-1378525428 tempest-ServersTestManualDisk-1378525428-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.070524] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Starting to schedule for instances: ['b2d5a232-1615-4622-9bdf-2ebd5bc45982'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 714.070817] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 714.070976] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.071149] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.071339] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.071508] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 714.134423] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.134423] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.134423] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.140967] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.140967] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.141139] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.144300] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.144419] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.144990] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='28',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_035445ac029043e9801da5cf6bc1f7b1='0',num_proj_12adf83e8fd04f929613209ea533d002='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='1',num_proj_3bfa2b43dd2b472d81d188daecf70313='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_83fc016eb04e424483fda0e1ec856d1b='0',num_proj_91f7a02359de48429f6f2b14a1646084='0',num_proj_bb8ada5c938f4729ad34a9a9442cd69b='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='2',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_proj_ee62738466de4d8caa03f04a86992f63='0',num_proj_f61427aeee17442ead99ee0494842480='0',num_proj_fc11fad6ba254dd29b27bff51ff2bcf4='0',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:28Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 714.145297] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 714.145376] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 714.145564] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Update host state with instances: ['22d20f77-3661-4981-944e-350f06e458f6', '53c40ff7-aec0-4b5e-b102-6ade1bd1d599', '2a5e19fb-ba10-4a9d-91ab-026d1a550229', '225ac277-4b75-424e-8055-1b2392647cd9', '0b7d36fa-1255-45f3-ac5b-ff9dff3621bd'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 714.145905] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.146049] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 714.146282] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.146705] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.146705] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.146936] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.147142] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.147604] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.147817] nova-scheduler[52224]: DEBUG nova.filters [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.148207] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 714.148459] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 714.148676] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Attempting to claim resources in the placement API for instance b2d5a232-1615-4622-9bdf-2ebd5bc45982 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 714.202262] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] [instance: b2d5a232-1615-4622-9bdf-2ebd5bc45982] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 714.203010] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.203227] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.203962] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-60b674f9-2995-41e8-a53c-065c1b94a8e0 tempest-ServersTestMultiNic-1573419358 tempest-ServersTestMultiNic-1573419358-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.820372] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Starting to schedule for instances: ['0f17950f-724d-4a4c-9632-78410e02b743'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 715.820372] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 715.820372] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.820372] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.820372] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.820665] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 715.861448] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.861672] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.861833] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.868506] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.868709] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.868873] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.871178] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.871378] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.871760] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='28',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_16d31e2b62c74c1083fe347d910d5bc5='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='2',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_task_spawning='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:29Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 715.872069] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 715.872243] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 715.872395] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Update host state with instances: ['53c40ff7-aec0-4b5e-b102-6ade1bd1d599', '2a5e19fb-ba10-4a9d-91ab-026d1a550229', '225ac277-4b75-424e-8055-1b2392647cd9', '0b7d36fa-1255-45f3-ac5b-ff9dff3621bd', 'b2d5a232-1615-4622-9bdf-2ebd5bc45982'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 715.872555] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.872804] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 715.872999] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.873431] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.873654] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.873823] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.873982] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.874142] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.874297] nova-scheduler[52226]: DEBUG nova.filters [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 715.874453] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 715.874617] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 715.874786] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Attempting to claim resources in the placement API for instance 0f17950f-724d-4a4c-9632-78410e02b743 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 715.927034] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] [instance: 0f17950f-724d-4a4c-9632-78410e02b743] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 715.927334] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 715.927615] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 715.927815] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7cc24d42-6289-49c1-a5c0-5b4d1d44015f tempest-ServerRescueTestJSON-1764868916 tempest-ServerRescueTestJSON-1764868916-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.886083] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Starting to schedule for instances: ['d69d6b4c-d7b3-444d-a1e4-09fabe0dc363'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 717.886381] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 717.886528] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.886705] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.886893] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 717.887069] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 717.949179] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.949439] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.949634] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.956139] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.956450] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.956567] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.959450] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 717.959740] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 717.960063] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='30',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_16d31e2b62c74c1083fe347d910d5bc5='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='1',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_task_None='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:31Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 717.960354] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 717.960515] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 717.960663] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Update host state with instances: ['2a5e19fb-ba10-4a9d-91ab-026d1a550229', '225ac277-4b75-424e-8055-1b2392647cd9', '0b7d36fa-1255-45f3-ac5b-ff9dff3621bd', 'b2d5a232-1615-4622-9bdf-2ebd5bc45982', '0f17950f-724d-4a4c-9632-78410e02b743'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 717.960816] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 717.961067] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 717.961500] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.961500] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.961621] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.961802] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.961979] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.962120] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.962273] nova-scheduler[52224]: DEBUG nova.filters [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 717.962424] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 717.962585] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 717.962749] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Attempting to claim resources in the placement API for instance d69d6b4c-d7b3-444d-a1e4-09fabe0dc363 {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 718.053302] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] [instance: d69d6b4c-d7b3-444d-a1e4-09fabe0dc363] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 718.053770] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.053864] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.053994] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-75010452-f40a-4985-b152-a9a78e22171a tempest-InstanceActionsNegativeTestJSON-1607717171 tempest-InstanceActionsNegativeTestJSON-1607717171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.868665] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Starting to schedule for instances: ['b1e22600-c807-4172-982a-ec13939afb38'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 718.868665] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 718.868665] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.868665] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.868665] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.868665] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 718.910618] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.910859] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.911023] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.922115] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.922323] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.922478] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.924917] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.925118] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.925464] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='30',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_16d31e2b62c74c1083fe347d910d5bc5='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='1',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_task_None='2',num_task_spawning='3',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:32Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 718.925749] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 718.925915] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 718.926224] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Update host state with instances: ['2a5e19fb-ba10-4a9d-91ab-026d1a550229', '0b7d36fa-1255-45f3-ac5b-ff9dff3621bd', 'b2d5a232-1615-4622-9bdf-2ebd5bc45982', '0f17950f-724d-4a4c-9632-78410e02b743', 'd69d6b4c-d7b3-444d-a1e4-09fabe0dc363'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 718.926224] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.926465] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 718.926662] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.926840] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.927032] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.927193] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.927372] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.927544] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.927702] nova-scheduler[52226]: DEBUG nova.filters [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.927856] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 718.931103] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 718.931324] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Attempting to claim resources in the placement API for instance b1e22600-c807-4172-982a-ec13939afb38 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 719.016244] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] [instance: b1e22600-c807-4172-982a-ec13939afb38] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 719.016244] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.016244] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.016244] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f7cc50d5-f3bd-48e5-a931-215bc8beb9cc tempest-ServersNegativeTestJSON-1156089830 tempest-ServersNegativeTestJSON-1156089830-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.637474] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Starting to schedule for instances: ['a184d4f8-a440-4da8-92b9-fc750f760c0f'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 722.637767] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 722.637855] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.638026] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.638240] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.638431] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 722.684867] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.685082] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.685247] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.691739] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.692020] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.692275] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.694330] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.694676] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.695093] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='32',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='1',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:35Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 722.695449] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 722.695680] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 722.696193] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Update host state with instances: ['0b7d36fa-1255-45f3-ac5b-ff9dff3621bd', 'b2d5a232-1615-4622-9bdf-2ebd5bc45982', '0f17950f-724d-4a4c-9632-78410e02b743', 'd69d6b4c-d7b3-444d-a1e4-09fabe0dc363', 'b1e22600-c807-4172-982a-ec13939afb38'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 722.696193] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.696477] nova-scheduler[52224]: DEBUG nova.filters [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 722.696755] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 60.594644 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 722.696970] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 722.697180] nova-scheduler[52224]: INFO nova.filters [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filter ComputeFilter returned 0 hosts [ 722.697381] nova-scheduler[52224]: DEBUG nova.filters [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtering removed all hosts for the request with instance ID 'a184d4f8-a440-4da8-92b9-fc750f760c0f'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 722.697571] nova-scheduler[52224]: INFO nova.filters [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtering removed all hosts for the request with instance ID 'a184d4f8-a440-4da8-92b9-fc750f760c0f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 722.697797] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 722.697968] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-10cea97f-b5a5-4d3c-917e-605768285669 tempest-AttachInterfacesTestJSON-892068240 tempest-AttachInterfacesTestJSON-892068240-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 724.899755] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Starting to schedule for instances: ['7e54ea2c-108d-4d20-a5de-ba42bcf0578c'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 724.900058] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 724.900224] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.900422] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.900757] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.900953] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 724.942415] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.942594] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.942762] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.949184] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.949409] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.949581] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.951621] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.951846] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.952330] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='32',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='1',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:35Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 724.952620] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 724.952790] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 724.952945] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Update host state with instances: ['0b7d36fa-1255-45f3-ac5b-ff9dff3621bd', 'b2d5a232-1615-4622-9bdf-2ebd5bc45982', '0f17950f-724d-4a4c-9632-78410e02b743', 'd69d6b4c-d7b3-444d-a1e4-09fabe0dc363', 'b1e22600-c807-4172-982a-ec13939afb38'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 724.953104] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.953353] nova-scheduler[52226]: DEBUG nova.filters [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 724.953559] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 62.85148 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 724.953724] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 724.953888] nova-scheduler[52226]: INFO nova.filters [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Filter ComputeFilter returned 0 hosts [ 724.954032] nova-scheduler[52226]: DEBUG nova.filters [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Filtering removed all hosts for the request with instance ID '7e54ea2c-108d-4d20-a5de-ba42bcf0578c'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 724.954165] nova-scheduler[52226]: INFO nova.filters [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Filtering removed all hosts for the request with instance ID '7e54ea2c-108d-4d20-a5de-ba42bcf0578c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 724.954307] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 724.954450] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-5f752ba6-9b0c-44a0-b139-665db7c8e998 tempest-ServerGroupTestJSON-486009441 tempest-ServerGroupTestJSON-486009441-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 726.584252] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Starting to schedule for instances: ['92203e74-4eaa-47be-a195-e79ca07e46f1'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 726.584252] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 726.584252] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.584252] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.584252] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.584252] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 726.628234] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.628462] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.628629] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.635753] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.635971] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.636148] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.638238] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 726.638444] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 726.638834] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='32',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='1',num_proj_dd3d716d593b4c27b2a452e31bd897d3='1',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:35Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=5) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 726.639126] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 726.639298] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 726.639473] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Update host state with instances: ['0b7d36fa-1255-45f3-ac5b-ff9dff3621bd', 'b2d5a232-1615-4622-9bdf-2ebd5bc45982', '0f17950f-724d-4a4c-9632-78410e02b743', 'd69d6b4c-d7b3-444d-a1e4-09fabe0dc363', 'b1e22600-c807-4172-982a-ec13939afb38'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 726.639642] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.639891] nova-scheduler[52224]: DEBUG nova.filters [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 726.640110] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 64.538017 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 726.640264] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 726.640436] nova-scheduler[52224]: INFO nova.filters [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Filter ComputeFilter returned 0 hosts [ 726.640592] nova-scheduler[52224]: DEBUG nova.filters [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Filtering removed all hosts for the request with instance ID '92203e74-4eaa-47be-a195-e79ca07e46f1'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 726.640727] nova-scheduler[52224]: INFO nova.filters [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Filtering removed all hosts for the request with instance ID '92203e74-4eaa-47be-a195-e79ca07e46f1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 726.640870] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 726.641013] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-4989a15d-2545-4087-a447-579bc4784742 tempest-ServerMetadataTestJSON-1072442799 tempest-ServerMetadataTestJSON-1072442799-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 729.065737] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Starting to schedule for instances: ['b2cef9f6-e919-4be8-8864-8a62b306290b'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 729.066035] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 729.066193] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 729.066372] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 729.066595] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 729.066748] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 729.111810] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 729.111810] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 729.111810] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 729.119769] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 729.120121] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 729.120467] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 729.122782] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 729.123256] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 729.123779] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='33',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='1',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='1',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='1',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='3',num_task_spawning='1',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:41Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=4) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 729.124276] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 729.124579] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 729.125058] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Update host state with instances: ['b2d5a232-1615-4622-9bdf-2ebd5bc45982', '0f17950f-724d-4a4c-9632-78410e02b743', 'd69d6b4c-d7b3-444d-a1e4-09fabe0dc363', 'b1e22600-c807-4172-982a-ec13939afb38'] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 729.125398] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 729.126237] nova-scheduler[52226]: DEBUG nova.filters [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 729.126821] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 67.024475 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 729.127135] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 729.127554] nova-scheduler[52226]: INFO nova.filters [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Filter ComputeFilter returned 0 hosts [ 729.127838] nova-scheduler[52226]: DEBUG nova.filters [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Filtering removed all hosts for the request with instance ID 'b2cef9f6-e919-4be8-8864-8a62b306290b'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 729.128173] nova-scheduler[52226]: INFO nova.filters [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Filtering removed all hosts for the request with instance ID 'b2cef9f6-e919-4be8-8864-8a62b306290b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 729.128473] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 729.129174] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-53beda55-fe01-403a-8832-87f1e076dfe2 tempest-ServerMetadataNegativeTestJSON-350027834 tempest-ServerMetadataNegativeTestJSON-350027834-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 731.658790] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Starting to schedule for instances: ['e9f31e18-ff4f-45ab-9512-a444da50c279'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 731.659072] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 731.659233] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.659428] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.659640] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.659812] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 731.711368] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.711368] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.711368] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.717372] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.717735] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.718015] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.721092] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.721774] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.722301] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='35',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='1',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='1',num_task_spawning='0',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=1) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 731.722787] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 731.723063] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 731.723349] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Update host state with instances: ['b1e22600-c807-4172-982a-ec13939afb38'] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 731.723620] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.724240] nova-scheduler[52224]: DEBUG nova.filters [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.724808] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 69.622443 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 731.725072] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 731.725416] nova-scheduler[52224]: INFO nova.filters [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Filter ComputeFilter returned 0 hosts [ 731.725661] nova-scheduler[52224]: DEBUG nova.filters [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Filtering removed all hosts for the request with instance ID 'e9f31e18-ff4f-45ab-9512-a444da50c279'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 731.726229] nova-scheduler[52224]: INFO nova.filters [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Filtering removed all hosts for the request with instance ID 'e9f31e18-ff4f-45ab-9512-a444da50c279'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 731.728089] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.728373] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-2611de10-7595-462c-be4d-49d664709f72 tempest-FloatingIPsAssociationNegativeTestJSON-51995472 tempest-FloatingIPsAssociationNegativeTestJSON-51995472-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 739.488241] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Starting to schedule for instances: ['cc9e6a29-ef9d-43fa-98b7-b49e31334c05'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 739.488529] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 739.488682] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 739.488895] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 739.489047] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 739.489238] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 739.531906] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.532161] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.532326] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 739.540287] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.540504] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.540666] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 739.542852] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.542980] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.543317] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 739.543637] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 739.544186] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 739.544186] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 739.544186] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 739.544387] nova-scheduler[52226]: DEBUG nova.filters [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 739.544603] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 77.442511 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 739.544746] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 739.544899] nova-scheduler[52226]: INFO nova.filters [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Filter ComputeFilter returned 0 hosts [ 739.545160] nova-scheduler[52226]: DEBUG nova.filters [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Filtering removed all hosts for the request with instance ID 'cc9e6a29-ef9d-43fa-98b7-b49e31334c05'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 739.545160] nova-scheduler[52226]: INFO nova.filters [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Filtering removed all hosts for the request with instance ID 'cc9e6a29-ef9d-43fa-98b7-b49e31334c05'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 739.545313] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 739.545430] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-a08784b3-b8c8-4d2c-8841-e7e2db200b83 tempest-ServersNegativeTestMultiTenantJSON-106500792 tempest-ServersNegativeTestMultiTenantJSON-106500792-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 749.902608] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Starting to schedule for instances: ['54e99a2d-8d74-4c68-a119-807b081ae738'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 749.902898] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 749.903064] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 749.903233] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 749.903429] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 749.903653] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 749.963638] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 749.963865] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 749.964036] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 749.971980] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 749.972200] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 749.972358] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 749.982088] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 749.982440] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 749.982679] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 749.982974] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 749.983136] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 749.983286] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 749.983703] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 749.983973] nova-scheduler[52224]: DEBUG nova.filters [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 749.984198] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 87.882116 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 749.984344] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 749.984490] nova-scheduler[52224]: INFO nova.filters [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filter ComputeFilter returned 0 hosts [ 749.984630] nova-scheduler[52224]: DEBUG nova.filters [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filtering removed all hosts for the request with instance ID '54e99a2d-8d74-4c68-a119-807b081ae738'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 749.984758] nova-scheduler[52224]: INFO nova.filters [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filtering removed all hosts for the request with instance ID '54e99a2d-8d74-4c68-a119-807b081ae738'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 749.984894] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 749.985041] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-e94260c4-07d1-4662-9ea9-cced2fe97452 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 751.793738] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Starting to schedule for instances: ['44d6921c-c05a-46f0-8d7f-8fa6ea7f8d3c'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 751.794030] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 751.794203] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.794394] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.794583] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.794768] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 751.837655] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.837899] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.838196] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.845717] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.845920] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.846087] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.848262] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.848457] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.848819] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 751.849099] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 751.849265] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 751.849505] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 751.849678] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.849935] nova-scheduler[52226]: DEBUG nova.filters [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 751.850137] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 89.74806 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 751.850304] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 751.850510] nova-scheduler[52226]: INFO nova.filters [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filter ComputeFilter returned 0 hosts [ 751.850714] nova-scheduler[52226]: DEBUG nova.filters [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filtering removed all hosts for the request with instance ID '44d6921c-c05a-46f0-8d7f-8fa6ea7f8d3c'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 751.850859] nova-scheduler[52226]: INFO nova.filters [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filtering removed all hosts for the request with instance ID '44d6921c-c05a-46f0-8d7f-8fa6ea7f8d3c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 751.851004] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 751.851144] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-039c4906-4545-4aaa-81b9-dd136f3979ef tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 753.888459] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Starting to schedule for instances: ['e93da8c5-dd74-4a2c-9351-33e692a37c6c'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 753.888895] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 753.889003] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 753.889215] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 753.889472] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 753.889707] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 753.933982] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 753.934209] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 753.934368] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 753.941326] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 753.941538] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 753.941693] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 753.943647] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 753.943838] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 753.944231] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 753.944524] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 753.944682] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 753.944824] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 753.944975] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 753.945226] nova-scheduler[52224]: DEBUG nova.filters [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 753.945442] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 91.84335 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 753.945592] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 753.945736] nova-scheduler[52224]: INFO nova.filters [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filter ComputeFilter returned 0 hosts [ 753.945871] nova-scheduler[52224]: DEBUG nova.filters [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filtering removed all hosts for the request with instance ID 'e93da8c5-dd74-4a2c-9351-33e692a37c6c'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 753.945996] nova-scheduler[52224]: INFO nova.filters [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filtering removed all hosts for the request with instance ID 'e93da8c5-dd74-4a2c-9351-33e692a37c6c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 753.946133] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 753.946273] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-f9ef6254-4ab5-4c63-a1a7-dc05e64c3dd0 tempest-VolumesAdminNegativeTest-822160615 tempest-VolumesAdminNegativeTest-822160615-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 755.690909] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Starting to schedule for instances: ['2557aec2-2668-4d4d-a31a-47bc9897c366'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 755.691195] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 755.691353] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.691528] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.691721] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.691897] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 755.757057] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.757323] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.758189] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.764679] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.765058] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.765310] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.767664] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.767664] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.768376] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 755.768994] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 755.768994] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 755.769155] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 755.769572] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.769663] nova-scheduler[52226]: DEBUG nova.filters [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 755.769868] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 93.667751 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 755.770025] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 755.770181] nova-scheduler[52226]: INFO nova.filters [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Filter ComputeFilter returned 0 hosts [ 755.770393] nova-scheduler[52226]: DEBUG nova.filters [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Filtering removed all hosts for the request with instance ID '2557aec2-2668-4d4d-a31a-47bc9897c366'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 755.770599] nova-scheduler[52226]: INFO nova.filters [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Filtering removed all hosts for the request with instance ID '2557aec2-2668-4d4d-a31a-47bc9897c366'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 755.770806] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 755.770971] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-5dfdc679-3503-4dbf-b8da-0bdcbd038150 tempest-ServerAddressesNegativeTestJSON-1657214758 tempest-ServerAddressesNegativeTestJSON-1657214758-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 760.396882] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['6ba7f90a-b5ec-43a7-9a5d-6f48c1a26262'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 760.397632] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 760.397754] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.397933] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.398123] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.398296] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 760.441571] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.441773] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.441981] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.452808] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.453021] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.453177] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.455419] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.455715] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.456285] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 760.456629] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 760.456798] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 760.457102] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 760.457102] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.457440] nova-scheduler[52224]: DEBUG nova.filters [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 760.457685] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 98.355577 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 760.458455] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 760.458838] nova-scheduler[52224]: INFO nova.filters [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 760.458838] nova-scheduler[52224]: DEBUG nova.filters [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '6ba7f90a-b5ec-43a7-9a5d-6f48c1a26262'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 760.458958] nova-scheduler[52224]: INFO nova.filters [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '6ba7f90a-b5ec-43a7-9a5d-6f48c1a26262'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 760.459087] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 760.459225] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-327bf241-6cce-4bbb-8009-589bf4de1e95 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 760.993564] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Starting to schedule for instances: ['0df64945-0a6a-47db-959f-25f5562d7823'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 760.993916] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 760.994144] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.994392] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.994650] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.994894] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 761.036229] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.036499] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.036676] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.043708] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.043937] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.044466] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.046355] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.055994] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.055994] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 761.055994] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 761.055994] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 761.056466] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 761.056911] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.010s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.057687] nova-scheduler[52226]: DEBUG nova.filters [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 761.057687] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 98.955308 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 761.057687] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 761.057886] nova-scheduler[52226]: INFO nova.filters [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filter ComputeFilter returned 0 hosts [ 761.057886] nova-scheduler[52226]: DEBUG nova.filters [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filtering removed all hosts for the request with instance ID '0df64945-0a6a-47db-959f-25f5562d7823'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 761.058034] nova-scheduler[52226]: INFO nova.filters [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filtering removed all hosts for the request with instance ID '0df64945-0a6a-47db-959f-25f5562d7823'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 761.058180] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 761.058322] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c408d1d4-a916-4e7c-a2ed-1f68e4a74f90 tempest-AttachVolumeShelveTestJSON-1941885383 tempest-AttachVolumeShelveTestJSON-1941885383-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 763.202581] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['2d5d4696-3d5b-4bfb-8e59-07eee1568a55'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 763.203152] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 763.203246] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.203433] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.203627] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.203805] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 763.256532] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.256608] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.256774] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.263647] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.263874] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.264059] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.266033] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.266230] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.266597] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 763.266894] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 763.267062] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 763.267213] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 763.267369] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.267660] nova-scheduler[52224]: DEBUG nova.filters [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 763.267873] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 101.16579 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 763.268037] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 763.268192] nova-scheduler[52224]: INFO nova.filters [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 763.268336] nova-scheduler[52224]: DEBUG nova.filters [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '2d5d4696-3d5b-4bfb-8e59-07eee1568a55'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 763.268481] nova-scheduler[52224]: INFO nova.filters [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '2d5d4696-3d5b-4bfb-8e59-07eee1568a55'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 763.268617] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 763.268769] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-8be9c35d-d0b8-4131-b84e-247b9ea20c63 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 765.091242] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Starting to schedule for instances: ['701b7f0a-9cf4-43a6-aabf-028690d8f360'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 765.091242] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 765.091437] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.091470] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.091651] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.091838] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 765.145574] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.145574] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.145674] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.154669] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.155480] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.155775] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.159574] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.159574] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.159574] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 765.159806] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 765.159806] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 765.159946] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 765.160108] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.160384] nova-scheduler[52226]: DEBUG nova.filters [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 765.160610] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 103.058516 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 765.160770] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 765.160922] nova-scheduler[52226]: INFO nova.filters [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Filter ComputeFilter returned 0 hosts [ 765.161068] nova-scheduler[52226]: DEBUG nova.filters [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Filtering removed all hosts for the request with instance ID '701b7f0a-9cf4-43a6-aabf-028690d8f360'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 765.161203] nova-scheduler[52226]: INFO nova.filters [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Filtering removed all hosts for the request with instance ID '701b7f0a-9cf4-43a6-aabf-028690d8f360'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 765.161346] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 765.161489] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-7de78f6b-b4b8-4214-a1e2-2aa63c9d936e tempest-ServerPasswordTestJSON-1521789453 tempest-ServerPasswordTestJSON-1521789453-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 766.498103] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Starting to schedule for instances: ['280e595e-11c5-4b71-a24f-34d6e98c1838'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 766.498103] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 766.498103] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.498103] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.498103] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.498103] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 766.538949] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.539290] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.539542] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.547120] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.547371] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.547548] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.549626] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.549827] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.550214] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 766.550515] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 766.550676] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 766.550823] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 766.550980] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.551244] nova-scheduler[52224]: DEBUG nova.filters [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 766.551494] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 104.44937 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 766.551607] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 766.551766] nova-scheduler[52224]: INFO nova.filters [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Filter ComputeFilter returned 0 hosts [ 766.551912] nova-scheduler[52224]: DEBUG nova.filters [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Filtering removed all hosts for the request with instance ID '280e595e-11c5-4b71-a24f-34d6e98c1838'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 766.552065] nova-scheduler[52224]: INFO nova.filters [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Filtering removed all hosts for the request with instance ID '280e595e-11c5-4b71-a24f-34d6e98c1838'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 766.552206] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 766.552350] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-a0a00b5a-3e74-4e51-8396-6b71a83f5541 tempest-InstanceActionsV221TestJSON-927192199 tempest-InstanceActionsV221TestJSON-927192199-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 766.570458] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['1f4efb6d-0156-47e9-90b0-0a4ded915aa5'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 766.571158] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 766.571338] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.571523] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.571726] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.571901] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 766.619235] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.619554] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.619771] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.629623] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.629623] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.629623] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.633689] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.633689] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.633689] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 766.633689] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 766.633689] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 766.633689] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 766.633689] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.634063] nova-scheduler[52226]: DEBUG nova.filters [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 766.634063] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 104.531961 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 766.634339] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 766.634339] nova-scheduler[52226]: INFO nova.filters [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 766.634494] nova-scheduler[52226]: DEBUG nova.filters [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '1f4efb6d-0156-47e9-90b0-0a4ded915aa5'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 766.634624] nova-scheduler[52226]: INFO nova.filters [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '1f4efb6d-0156-47e9-90b0-0a4ded915aa5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 766.634762] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 766.634981] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-2039f5a7-446c-4781-bc2f-8fe0a41449e3 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.613379] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['1214e8e0-2c63-4944-9067-f88c23893c77'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.613683] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.613826] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.613996] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.614181] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.614352] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.659922] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.660123] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.660290] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.666786] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.667286] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.667286] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.669409] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.670060] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.670551] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.670850] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.671193] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.671193] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.671331] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.671565] nova-scheduler[52224]: DEBUG nova.filters [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.671780] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 105.569689 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.671986] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 767.673320] nova-scheduler[52224]: INFO nova.filters [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 767.673613] nova-scheduler[52224]: DEBUG nova.filters [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '1214e8e0-2c63-4944-9067-f88c23893c77'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.673759] nova-scheduler[52224]: INFO nova.filters [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '1214e8e0-2c63-4944-9067-f88c23893c77'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.674700] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.674879] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-7fcdd1a9-8ad1-41d3-83de-776617891b87 tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 768.175226] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Starting to schedule for instances: ['1f15fcfb-9c87-4545-99aa-4f3a879beda3'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 768.175594] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 768.175703] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.175844] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.176069] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.176270] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 768.229270] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.229549] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.229728] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.237404] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.237625] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.237791] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.239695] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.239890] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.240355] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 768.244195] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 768.244195] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 768.244195] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 768.244195] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.244195] nova-scheduler[52226]: DEBUG nova.filters [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 768.244195] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 106.139679 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 768.244195] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 768.244195] nova-scheduler[52226]: INFO nova.filters [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Filter ComputeFilter returned 0 hosts [ 768.244195] nova-scheduler[52226]: DEBUG nova.filters [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Filtering removed all hosts for the request with instance ID '1f15fcfb-9c87-4545-99aa-4f3a879beda3'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 768.244195] nova-scheduler[52226]: INFO nova.filters [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Filtering removed all hosts for the request with instance ID '1f15fcfb-9c87-4545-99aa-4f3a879beda3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 768.244195] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 768.244772] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-9cdb6206-0c15-4844-bd80-b6d78adfb318 tempest-AttachInterfacesV270Test-1721489478 tempest-AttachInterfacesV270Test-1721489478-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 769.566385] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['9fd611c9-df04-43a6-aa8a-e1e585e154b0'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 769.566632] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 769.566757] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.566930] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.567163] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 769.567288] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 769.611488] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.611750] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.611920] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.618502] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.618746] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.618935] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.620908] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 769.621107] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 769.621478] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 769.621769] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 769.621934] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 769.622086] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 769.622245] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 769.622504] nova-scheduler[52224]: DEBUG nova.filters [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 769.622717] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 107.520635 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 769.622906] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 769.624834] nova-scheduler[52224]: INFO nova.filters [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 769.624834] nova-scheduler[52224]: DEBUG nova.filters [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '9fd611c9-df04-43a6-aa8a-e1e585e154b0'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 769.624834] nova-scheduler[52224]: INFO nova.filters [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID '9fd611c9-df04-43a6-aa8a-e1e585e154b0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 769.624834] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 769.624834] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-94e6d0da-5806-497f-badb-d37edee172ec tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.049934] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Starting to schedule for instances: ['84517a92-46c7-4bb2-a77e-d092ab8b6afd'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.050316] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.050419] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.050654] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.050774] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.050949] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.090361] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.090361] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.090361] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.100164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.100164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.100164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.100164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.100164] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.100164] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.100164] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.100508] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.100508] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.100508] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.100508] nova-scheduler[52226]: DEBUG nova.filters [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.100508] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 107.997168 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.100508] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 770.100508] nova-scheduler[52226]: INFO nova.filters [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Filter ComputeFilter returned 0 hosts [ 770.100508] nova-scheduler[52226]: DEBUG nova.filters [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Filtering removed all hosts for the request with instance ID '84517a92-46c7-4bb2-a77e-d092ab8b6afd'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.100508] nova-scheduler[52226]: INFO nova.filters [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Filtering removed all hosts for the request with instance ID '84517a92-46c7-4bb2-a77e-d092ab8b6afd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.100508] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.100508] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-abc9bd1d-0e06-46a5-bbf1-26d32d81508c tempest-ServerActionsV293TestJSON-1156967 tempest-ServerActionsV293TestJSON-1156967-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 772.600481] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['bf9a8d20-7305-4f2f-bdbd-32672c3b9361'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 772.600481] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 772.600481] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.600481] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.600481] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.600481] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 772.643446] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.643446] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.643446] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.649896] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.653945] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.653945] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.653945] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.653945] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.653945] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 772.654394] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 772.654612] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 772.655051] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 772.655303] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.655624] nova-scheduler[52224]: DEBUG nova.filters [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 772.656223] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 110.553805 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 772.656483] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 772.657535] nova-scheduler[52224]: INFO nova.filters [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 772.657773] nova-scheduler[52224]: DEBUG nova.filters [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID 'bf9a8d20-7305-4f2f-bdbd-32672c3b9361'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 772.657910] nova-scheduler[52224]: INFO nova.filters [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID 'bf9a8d20-7305-4f2f-bdbd-32672c3b9361'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 772.658066] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 772.658240] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-6da2ccb4-db25-49ca-b8d1-5f143163615b tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 773.381546] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 773.381908] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 773.382006] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 773.382080] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Successfully synced instances from host 'cpu-1'. {{(pid=52226) sync_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:972}} [ 773.382162] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 773.382240] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 773.382375] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Successfully synced instances from host 'cpu-1'. {{(pid=52224) sync_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:972}} [ 773.382560] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-f4212924-c7e3-48e5-98ce-aa3cbfc8691e None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.632588] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting to schedule for instances: ['fbfa4070-0a09-49f3-a3af-16ab962f6acf'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 774.632900] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 774.633059] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.633230] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.633417] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.633584] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 774.676525] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 774.676606] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 774.676745] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.683105] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 774.683318] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 774.683670] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='36',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_16d31e2b62c74c1083fe347d910d5bc5='0',num_proj_3218ff302f5940deb63d1a112bc9e213='0',num_proj_5a6ff58370d34fe19123cce5d42e2246='0',num_proj_6b57eaa0935b47d3a7a0e22090a2615a='0',num_proj_bed9df06997844efbe4af7a11c0e5fff='0',num_proj_daa27b81325b47c3b14ff094f9c93ea8='0',num_proj_dd3d716d593b4c27b2a452e31bd897d3='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:04:45Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 774.683941] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 774.684120] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 774.684275] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 774.684433] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.684680] nova-scheduler[52226]: DEBUG nova.filters [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 774.684881] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 112.582804 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 774.685031] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 774.685178] nova-scheduler[52226]: INFO nova.filters [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filter ComputeFilter returned 0 hosts [ 774.685320] nova-scheduler[52226]: DEBUG nova.filters [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID 'fbfa4070-0a09-49f3-a3af-16ab962f6acf'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 774.685453] nova-scheduler[52226]: INFO nova.filters [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtering removed all hosts for the request with instance ID 'fbfa4070-0a09-49f3-a3af-16ab962f6acf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 774.685595] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 774.685734] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-01497f42-d421-44a6-90e3-d65f3f9bfccb tempest-DeleteServersTestJSON-1724210205 tempest-DeleteServersTestJSON-1724210205-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 777.061283] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Starting to schedule for instances: ['34403a1a-b7a1-4e0c-9134-bb62f3078268'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 777.061571] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 777.062004] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.062271] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.063703] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.063703] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 777.101928] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 777.102189] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 777.102392] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 777.108952] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 777.109159] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 777.109555] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='38'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:05:30Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 777.109833] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 777.110002] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 777.110131] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 777.110283] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 777.110557] nova-scheduler[52224]: DEBUG nova.filters [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 777.110759] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 115.008683 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 777.110907] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 777.111083] nova-scheduler[52224]: INFO nova.filters [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filter ComputeFilter returned 0 hosts [ 777.111186] nova-scheduler[52224]: DEBUG nova.filters [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filtering removed all hosts for the request with instance ID '34403a1a-b7a1-4e0c-9134-bb62f3078268'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 777.111310] nova-scheduler[52224]: INFO nova.filters [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filtering removed all hosts for the request with instance ID '34403a1a-b7a1-4e0c-9134-bb62f3078268'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 777.111447] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 777.111583] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-9e70e74d-fc26-4965-94c6-fc04dfc32e2c tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 777.296489] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Starting to schedule for instances: ['d1603c7b-5177-4d99-be65-6b450d73e6d8'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 777.296778] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 777.296937] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.297113] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.297319] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 777.297516] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 777.336645] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 777.336914] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 777.337080] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 777.343445] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 777.343654] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 777.344034] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='38'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:05:30Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 777.344291] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 777.344462] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 777.344618] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 777.344781] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 777.345028] nova-scheduler[52226]: DEBUG nova.filters [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 777.345246] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 115.243155 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 777.345414] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 777.345548] nova-scheduler[52226]: INFO nova.filters [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ComputeFilter returned 0 hosts [ 777.345693] nova-scheduler[52226]: DEBUG nova.filters [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtering removed all hosts for the request with instance ID 'd1603c7b-5177-4d99-be65-6b450d73e6d8'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 777.345856] nova-scheduler[52226]: INFO nova.filters [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtering removed all hosts for the request with instance ID 'd1603c7b-5177-4d99-be65-6b450d73e6d8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 777.346003] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 777.346142] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-4c97424e-b900-4eeb-ada6-36f7660fd2b6 tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 779.821661] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Starting to schedule for instances: ['29e37b46-0e24-4fe2-ba92-4c916ca046da'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 779.822128] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 779.822471] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.822510] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.822746] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.822886] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 779.862829] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.863045] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.863203] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.870017] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.870214] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.870596] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='38'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:05:30Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 779.870871] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 779.871031] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 779.871175] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 779.871329] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.871604] nova-scheduler[52224]: DEBUG nova.filters [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 779.871815] nova-scheduler[52224]: DEBUG nova.servicegroup.drivers.db [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 117.769728 {{(pid=52224) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 779.871967] nova-scheduler[52224]: WARNING nova.scheduler.filters.compute_filter [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 779.872122] nova-scheduler[52224]: INFO nova.filters [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filter ComputeFilter returned 0 hosts [ 779.872266] nova-scheduler[52224]: DEBUG nova.filters [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filtering removed all hosts for the request with instance ID '29e37b46-0e24-4fe2-ba92-4c916ca046da'. Filter results: [('ComputeFilter', None)] {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 779.872395] nova-scheduler[52224]: INFO nova.filters [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filtering removed all hosts for the request with instance ID '29e37b46-0e24-4fe2-ba92-4c916ca046da'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 779.872533] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] Filtered [] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 779.872670] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-334594d3-1c0e-4c29-b661-89c94b7ff045 tempest-AttachVolumeTestJSON-1223709734 tempest-AttachVolumeTestJSON-1223709734-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52224) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 780.281531] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Starting to schedule for instances: ['2f9ae38f-4747-4252-9722-567bf9a4f49c'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 780.281829] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 780.281987] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.282163] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.282372] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.282563] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 780.321022] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.321304] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.321415] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.327656] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.327889] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.328349] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='38'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:05:30Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 780.328658] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 780.328825] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 3, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 780.328979] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 780.329142] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.329389] nova-scheduler[52226]: DEBUG nova.filters [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 780.329623] nova-scheduler[52226]: DEBUG nova.servicegroup.drivers.db [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-07-30 07:03:36. Elapsed time is 118.227527 {{(pid=52226) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 780.329781] nova-scheduler[52226]: WARNING nova.scheduler.filters.compute_filter [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 780.329931] nova-scheduler[52226]: INFO nova.filters [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ComputeFilter returned 0 hosts [ 780.330075] nova-scheduler[52226]: DEBUG nova.filters [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtering removed all hosts for the request with instance ID '2f9ae38f-4747-4252-9722-567bf9a4f49c'. Filter results: [('ComputeFilter', None)] {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 780.330208] nova-scheduler[52226]: INFO nova.filters [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtering removed all hosts for the request with instance ID '2f9ae38f-4747-4252-9722-567bf9a4f49c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 780.330347] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtered [] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 780.330534] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-c85fe416-c8fb-4e52-9fa3-616267ddd92d tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52226) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 782.964695] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Starting to schedule for instances: ['1d7f04f0-6a1a-4122-8ae3-71a0185c94fb'] {{(pid=52224) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 782.964992] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52224) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 782.965153] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.965334] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.965528] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52224) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.965711] nova-scheduler[52224]: DEBUG nova.scheduler.request_filter [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] ephemeral_encryption_filter skipped {{(pid=52224) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 783.007740] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.007740] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.007740] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.014082] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.014302] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.014653] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='38'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:05:30Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=0) {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 783.014920] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Update host state with aggregates: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 783.015087] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 5, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 5, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 783.015238] nova-scheduler[52224]: DEBUG nova.scheduler.host_manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Update host state with instances: [] {{(pid=52224) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 783.015399] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.015663] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Starting with 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 783.015866] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.016152] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.016356] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.016521] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.016681] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.016842] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.016999] nova-scheduler[52224]: DEBUG nova.filters [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52224) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.017154] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 783.017319] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52224) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 783.017560] nova-scheduler[52224]: DEBUG nova.scheduler.utils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Attempting to claim resources in the placement API for instance 1d7f04f0-6a1a-4122-8ae3-71a0185c94fb {{(pid=52224) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 783.069185] nova-scheduler[52224]: DEBUG nova.scheduler.manager [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] [instance: 1d7f04f0-6a1a-4122-8ae3-71a0185c94fb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52224) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 783.069764] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.069980] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.070345] nova-scheduler[52224]: DEBUG oslo_concurrency.lockutils [None req-0e84cf7f-e5ee-41b7-8224-45e29ab70f41 tempest-ServersTestBootFromVolume-817680110 tempest-ServersTestBootFromVolume-817680110-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52224) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.467127] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Starting to schedule for instances: ['538c94e8-0b50-49c3-8392-55b1e8bbd652'] {{(pid=52226) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 783.467127] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52226) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 783.467503] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.467503] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.467567] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52226) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.467734] nova-scheduler[52226]: DEBUG nova.scheduler.request_filter [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] ephemeral_encryption_filter skipped {{(pid=52226) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 783.514148] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.514319] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.514487] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "b8904d0d-fa99-4946-a73d-f3e2509db3c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.521167] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.521382] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.521905] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-07-30T07:01:30Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='38',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_956ed525c44e4337b426453bdeac7df9='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-07-30T07:05:37Z,uuid=f238d7fc-e79d-48e7-bb26-b4d615d95009,vcpus=48,vcpus_used=1) {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 783.522035] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with aggregates: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 783.522177] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with service dict: {'id': 5, 'uuid': '925b4f6c-2c44-4e57-b9a0-5684494b9fa1', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 7, 30, 7, 5, 36, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 7, 30, 7, 1, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 7, 30, 7, 5, 36, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 783.522331] nova-scheduler[52226]: DEBUG nova.scheduler.host_manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Update host state with instances: [] {{(pid=52226) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 783.522490] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.522742] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Starting with 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 783.522940] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.523113] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.523303] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.523475] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.523635] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.523796] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.523953] nova-scheduler[52226]: DEBUG nova.filters [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52226) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 783.524123] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 204800MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 783.524292] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 204800MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=52226) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 783.524464] nova-scheduler[52226]: DEBUG nova.scheduler.utils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Attempting to claim resources in the placement API for instance 538c94e8-0b50-49c3-8392-55b1e8bbd652 {{(pid=52226) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 783.586815] nova-scheduler[52226]: DEBUG nova.scheduler.manager [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] [instance: 538c94e8-0b50-49c3-8392-55b1e8bbd652] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 204800MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=52226) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 783.587112] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.587331] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.587558] nova-scheduler[52226]: DEBUG oslo_concurrency.lockutils [None req-eaec0596-9b6b-4d4f-92ca-01636eb7de0b tempest-AttachVolumeNegativeTest-1970175979 tempest-AttachVolumeNegativeTest-1970175979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52226) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}