[ 452.733295] nova-scheduler[50382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 453.849562] nova-scheduler[50382]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 453.860681] nova-scheduler[50382]: DEBUG oslo_db.sqlalchemy.engines [None req-f00a787d-0e23-4b03-8217-57b0ec224083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50382) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 453.966046] nova-scheduler[50382]: DEBUG nova.scheduler.host_manager [None req-f00a787d-0e23-4b03-8217-57b0ec224083 None None] Found 1 cells: 11743078-64bf-4468-a786-557c60808969 {{(pid=50382) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 453.967112] nova-scheduler[50382]: DEBUG nova.scheduler.host_manager [None req-f00a787d-0e23-4b03-8217-57b0ec224083 None None] Found 0 disabled cells: {{(pid=50382) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 453.995785] nova-scheduler[50382]: DEBUG nova.scheduler.host_manager [None req-f00a787d-0e23-4b03-8217-57b0ec224083 None None] START:_async_init_instance_info {{(pid=50382) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 453.998649] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 453.998649] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 453.999026] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 454.004376] nova-scheduler[50382]: DEBUG oslo_db.sqlalchemy.engines [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50382) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 454.012800] nova-scheduler[50382]: DEBUG nova.scheduler.host_manager [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Total number of compute nodes: 0 {{(pid=50382) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 454.015297] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 454.015297] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 454.015297] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 454.067439] nova-scheduler[50382]: DEBUG nova.scheduler.host_manager [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] Adding 0 instances for hosts 10-20 {{(pid=50382) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 454.067439] nova-scheduler[50382]: DEBUG nova.scheduler.host_manager [None req-dbff17d0-91ab-40be-8b44-fca15a7cfff2 None None] END:_async_init_instance_info {{(pid=50382) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 454.087629] nova-scheduler[50382]: DEBUG nova.context [None req-f00a787d-0e23-4b03-8217-57b0ec224083 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11743078-64bf-4468-a786-557c60808969(cell1) {{(pid=50382) load_cells /opt/stack/nova/nova/context.py:464}} [ 454.087971] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 454.088178] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 454.088818] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 454.089327] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 454.089369] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 454.089495] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50382) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 454.096796] nova-scheduler[50382]: DEBUG oslo_db.sqlalchemy.engines [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50382) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 454.103101] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Acquiring lock "singleton_lock" {{(pid=50382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 454.103101] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Acquired lock "singleton_lock" {{(pid=50382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 454.103101] nova-scheduler[50382]: DEBUG oslo_concurrency.lockutils [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Releasing lock "singleton_lock" {{(pid=50382) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 454.103101] nova-scheduler[50382]: INFO oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Starting 2 workers [ 454.109020] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Started child 51429 {{(pid=50382) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 454.111925] nova-scheduler[51429]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 454.112452] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Started child 51431 {{(pid=50382) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 454.113116] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Full set of CONF: {{(pid=50382) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 454.113298] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ******************************************************************************** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 454.113446] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] Configuration options gathered from: {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 454.113613] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 454.114037] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] config files: ['/etc/nova/nova.conf'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 454.114153] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ================================================================================ {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 454.114548] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] allow_resize_to_same_host = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.114747] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] arq_binding_timeout = 300 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.114962] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] block_device_allocate_retries = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.115163] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] block_device_allocate_retries_interval = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.115363] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cert = self.pem {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.115480] nova-scheduler[51431]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 454.115647] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute_driver = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.115785] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute_monitors = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.116012] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] config_dir = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.116210] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] config_drive_format = iso9660 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.116354] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] config_file = ['/etc/nova/nova.conf'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.116571] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] config_source = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.116765] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] console_host = devstack {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.116973] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] control_exchange = nova {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.117215] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cpu_allocation_ratio = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.117399] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] daemon = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.117600] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] debug = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.117766] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] default_access_ip_network_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.118273] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] default_availability_zone = nova {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.118273] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] default_ephemeral_format = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.118425] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.118601] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] default_schedule_zone = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.118774] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] disk_allocation_ratio = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.118953] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] enable_new_services = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.119184] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] enabled_apis = ['osapi_compute'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.119367] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] enabled_ssl_apis = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.119546] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] flat_injected = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.119730] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] force_config_drive = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.119926] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] force_raw_images = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.120148] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] graceful_shutdown_timeout = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.120323] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] heal_instance_info_cache_interval = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.121148] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] host = devstack {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.121329] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] initial_cpu_allocation_ratio = 4.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.121494] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] initial_disk_allocation_ratio = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.121674] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] initial_ram_allocation_ratio = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122197] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122197] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_build_timeout = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122284] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_delete_interval = 300 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122424] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_format = [instance: %(uuid)s] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122582] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_name_template = instance-%08x {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122736] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_usage_audit = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.122986] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_usage_audit_period = month {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.123185] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.123375] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] instances_path = /opt/stack/data/nova/instances {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.123533] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] internal_service_availability_zone = internal {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.123684] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] key = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] live_migration_retry_count = 30 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_config_append = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_dir = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_options = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125225] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_rotate_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125454] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_rotate_interval_type = days {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125454] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] log_rotation_type = none {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125454] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125454] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125569] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125740] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125859] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.125946] nova-scheduler[51431]: DEBUG oslo_db.sqlalchemy.engines [None req-57c42398-7ca4-45a3-82f0-a17efad056bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51431) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 454.126115] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] long_rpc_timeout = 1800 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.126304] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] max_concurrent_builds = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.126462] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] max_concurrent_live_migrations = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.126632] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] max_concurrent_snapshots = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.126795] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] max_local_block_devices = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.126978] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] max_logfile_count = 30 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.127151] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] max_logfile_size_mb = 200 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131020] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] maximum_instance_delete_attempts = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131020] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metadata_listen = 0.0.0.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131020] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metadata_listen_port = 8775 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131176] nova-scheduler[51429]: DEBUG oslo_db.sqlalchemy.engines [None req-ad22131f-6ed8-4232-9e42-c70cf4371050 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51429) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 454.131213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metadata_workers = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] migrate_max_retries = -1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] mkisofs_cmd = genisoimage {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] my_block_storage_ip = 10.180.1.21 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] my_ip = 10.180.1.21 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] network_allocate_retries = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] osapi_compute_listen = 0.0.0.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] osapi_compute_listen_port = 8774 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] osapi_compute_unique_server_name_scope = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] osapi_compute_workers = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] password_length = 12 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] periodic_enable = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] periodic_fuzzy_delay = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] pointer_model = usbtablet {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] preallocate_images = none {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] publish_errors = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] pybasedir = /opt/stack/nova {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ram_allocation_ratio = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rate_limit_burst = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rate_limit_except_level = CRITICAL {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rate_limit_interval = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reboot_timeout = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reclaim_instance_interval = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] record = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.131853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reimage_timeout_per_gb = 20 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.132101] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] report_interval = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.132249] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rescue_timeout = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.132415] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reserved_host_cpus = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.132563] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reserved_host_disk_mb = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.132726] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reserved_host_memory_mb = 512 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.132913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] reserved_huge_pages = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.133076] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] resize_confirm_window = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.133401] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] resize_fs_using_block_device = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.133401] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] resume_guests_state_on_host_boot = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.133540] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.133949] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] run_external_periodic_tasks = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.133949] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] running_deleted_instance_action = reap {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.134028] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] running_deleted_instance_poll_interval = 1800 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.134194] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] running_deleted_instance_timeout = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.134343] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler_instance_sync_interval = 120 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.134515] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_down_time = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.134692] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] servicegroup_driver = db {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.134846] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] shelved_offload_time = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.135009] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] shelved_poll_interval = 3600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.135218] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] shutdown_timeout = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.135378] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] source_is_ipv6 = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.135549] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ssl_only = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.135734] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] state_path = /opt/stack/data/nova {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.135905] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] sync_power_state_interval = 600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.136074] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] sync_power_state_pool_size = 1000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.136361] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] syslog_log_facility = LOG_USER {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.136424] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] tempdir = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.136558] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] timeout_nbd = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.136715] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] transport_url = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.136865] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] update_resources_interval = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137029] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_cow_images = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137186] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_eventlog = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137334] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_journal = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137482] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_json = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137653] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_rootwrap_daemon = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137838] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_stderr = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.137987] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] use_syslog = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.138186] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vcpu_pin_set = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.138352] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vif_plugging_is_fatal = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.138515] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vif_plugging_timeout = 300 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.138715] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] virt_mkfs = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.138874] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] volume_usage_poll_interval = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.139042] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] watch_log_file = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.139340] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] web = /usr/share/spice-html5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 454.139525] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_concurrency.disable_process_locking = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.139734] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.139985] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.auth_strategy = keystone {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.140173] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.compute_link_prefix = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.140357] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.140540] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.dhcp_domain = novalocal {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.140709] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.enable_instance_password = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.140972] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.glance_link_prefix = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.141249] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.141521] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.instance_list_cells_batch_strategy = distributed {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.141809] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.instance_list_per_project_cells = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.142107] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.list_records_by_skipping_down_cells = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.142389] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.local_metadata_per_cell = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.142620] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.max_limit = 1000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.142810] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.metadata_cache_expiration = 15 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.142988] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.neutron_default_tenant_id = default {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.143164] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.use_forwarded_for = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.143347] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.use_neutron_default_nets = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.143528] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.143699] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_dynamic_failure_fatal = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.143853] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.144023] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_dynamic_ssl_certfile = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.144207] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_dynamic_targets = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.144362] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_jsonfile_path = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.144552] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api.vendordata_providers = ['StaticJSON'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.144805] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.backend = dogpile.cache.memcached {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.145158] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.backend_argument = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.145158] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.config_prefix = cache.oslo {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.145348] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.dead_timeout = 60.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.145509] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.debug_cache_backend = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.145661] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.enable_retry_client = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.145830] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.enable_socket_keepalive = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.enabled = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.expiration_time = 600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.hashclient_retry_attempts = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.hashclient_retry_delay = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_dead_retry = 300 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_password = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149026] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_pool_maxsize = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_sasl_enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_socket_timeout = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149312] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.memcache_username = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.proxies = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.retry_attempts = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.retry_delay = 0.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.socket_keepalive_count = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.socket_keepalive_idle = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.socket_keepalive_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.tls_allowed_ciphers = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149651] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.tls_cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149651] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.tls_certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149651] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.tls_enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.149807] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cache.tls_keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.150016] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.150637] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.auth_type = password {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.150637] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.150637] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.catalog_info = volumev3::publicURL {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.cross_az_attach = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.debug = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.endpoint_template = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.http_retries = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.151994] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152411] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152411] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.os_region_name = RegionOne {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152411] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152411] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cinder.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152647] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152682] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.cpu_dedicated_set = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.152843] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.cpu_shared_set = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.153063] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.image_type_exclude_list = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.153224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.live_migration_wait_for_vif_plug = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.153381] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.max_concurrent_disk_ops = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.153537] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.max_disk_devices_to_attach = -1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.153732] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.153882] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.154042] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.resource_provider_association_refresh = 300 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.154202] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.shutdown_retry_interval = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.154379] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.154441] nova-scheduler[51431]: DEBUG nova.service [None req-57c42398-7ca4-45a3-82f0-a17efad056bf None None] Creating RPC server for service scheduler {{(pid=51431) start /opt/stack/nova/nova/service.py:182}} [ 454.154551] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] conductor.workers = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.154729] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] console.allowed_origins = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.154887] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] console.ssl_ciphers = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.155064] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] console.ssl_minimum_version = default {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.155243] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] consoleauth.token_ttl = 600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.155437] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.155594] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.155754] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.155912] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.156074] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.156251] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.156408] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.156559] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.156715] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.156868] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.157055] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.region_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.157222] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.157386] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.service_type = accelerator {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.157544] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158051] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158051] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158051] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158190] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158348] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] cyborg.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158539] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.backend = sqlalchemy {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158717] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.connection = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.158887] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.connection_debug = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.159063] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.connection_parameters = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.159239] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.connection_recycle_time = 3600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.159418] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.connection_trace = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.159578] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.db_inc_retry_interval = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.159758] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.db_max_retries = 20 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160161] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.db_max_retry_interval = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160161] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.db_retry_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160254] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.max_overflow = 50 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160413] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.max_pool_size = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160580] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.max_retries = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160756] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.mysql_enable_ndb = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.160947] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.161122] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.mysql_wsrep_sync_wait = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.161281] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.pool_timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.161450] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.retry_interval = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.161610] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.slave_connection = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.161773] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.sqlite_synchronous = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.162293] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] database.use_db_reconnect = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.162293] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.backend = sqlalchemy {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.162388] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.connection = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.162469] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.connection_debug = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.162638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.connection_parameters = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163234] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.connection_recycle_time = 3600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163234] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.connection_trace = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163234] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.db_inc_retry_interval = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163343] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.db_max_retries = 20 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163403] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.db_max_retry_interval = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163556] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.db_retry_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163718] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.max_overflow = 50 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.163875] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.max_pool_size = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164041] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.max_retries = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.mysql_enable_ndb = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.mysql_wsrep_sync_wait = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.pool_timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.retry_interval = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.164959] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.slave_connection = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.165093] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] api_database.sqlite_synchronous = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.165282] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] devices.enabled_mdev_types = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.165321] nova-scheduler[51429]: DEBUG nova.service [None req-ad22131f-6ed8-4232-9e42-c70cf4371050 None None] Creating RPC server for service scheduler {{(pid=51429) start /opt/stack/nova/nova/service.py:182}} [ 454.165450] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.165604] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ephemeral_storage_encryption.enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.165788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ephemeral_storage_encryption.key_size = 512 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.165973] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.api_servers = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.166146] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.166316] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.166483] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.166658] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.166868] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.167544] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.debug = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.167544] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.default_trusted_certificate_ids = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.167544] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.enable_certificate_validation = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.167544] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.enable_rbd_download = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.167714] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.167863] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168025] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168180] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168634] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168634] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.num_retries = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168634] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.rbd_ceph_conf = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168799] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.rbd_connect_timeout = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.168958] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.rbd_pool = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.169141] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.rbd_user = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.region_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.service_type = image {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170224] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170458] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170585] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.verify_glance_signatures = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.170745] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] glance.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171174] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] guestfs.debug = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171174] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.config_drive_cdrom = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171295] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.config_drive_inject_password = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171975] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171975] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.enable_instance_metrics_collection = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171975] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.enable_remotefx = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.171975] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.instances_path_share = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.172211] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.iscsi_initiator_list = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.172313] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.limit_cpu_features = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.172467] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.172655] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.172903] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.power_state_check_timeframe = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.172944] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.power_state_event_polling_interval = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.173676] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.173676] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.use_multipath_io = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.173676] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.volume_attach_retry_count = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.173676] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.volume_attach_retry_interval = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.173834] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.vswitch_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.173860] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.174082] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] mks.enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.174691] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.174876] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] image_cache.manager_interval = 2400 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.175076] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] image_cache.precache_concurrency = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.175245] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] image_cache.remove_unused_base_images = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.175417] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176129] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176129] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] image_cache.subdirectory_name = _base {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176129] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.api_max_retries = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176129] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.api_retry_interval = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176300] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176747] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.auth_type = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176747] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176747] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176877] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.176991] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.177154] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.177300] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.177458] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.177608] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178178] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178178] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178178] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.partition_key = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178330] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.peer_list = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178365] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.region_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178505] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.serial_console_state_timeout = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178689] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178810] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.service_type = baremetal {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.178966] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.179129] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.179279] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.179429] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.179600] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.179783] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ironic.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.180007] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.180211] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] key_manager.fixed_key = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.180423] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.180586] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.barbican_api_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.180758] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.barbican_endpoint = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.181013] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.barbican_endpoint_type = public {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.181216] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.barbican_region_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.181393] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.181549] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.181711] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.181886] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.182066] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.182388] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.number_of_retries = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.182388] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.retry_delay = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.182539] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.send_service_user_token = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.182713] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.182863] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183023] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.verify_ssl = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183174] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican.verify_ssl_path = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183355] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183487] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.auth_type = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183641] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183678] nova-scheduler[51431]: DEBUG nova.service [None req-57c42398-7ca4-45a3-82f0-a17efad056bf None None] Join ServiceGroup membership for this service scheduler {{(pid=51431) start /opt/stack/nova/nova/service.py:199}} [ 454.183794] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.183992] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-57c42398-7ca4-45a3-82f0-a17efad056bf None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51431) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 454.184065] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.184112] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.184254] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.184434] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.184671] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] barbican_service_user.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.184742] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.approle_role_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185024] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.approle_secret_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185063] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185202] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185360] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185609] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185646] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185830] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.kv_mountpoint = secret {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.185989] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.kv_version = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.186172] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.namespace = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.186324] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.root_token_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.186475] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.186627] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.ssl_ca_crt_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.186779] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.186932] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.use_ssl = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.187123] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.187304] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.187471] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.187633] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188092] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188092] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188092] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188395] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188395] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188515] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188660] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188811] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.region_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.188964] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.189136] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.service_type = identity {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.189291] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.189425] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.189604] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.189741] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.189941] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.190084] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] keystone.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.190307] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.connection_uri = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.190487] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_mode = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191036] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_model_extra_flags = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191036] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_models = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191036] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_power_governor_high = performance {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191150] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_power_governor_low = powersave {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191308] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_power_management = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191375] nova-scheduler[51429]: DEBUG nova.service [None req-ad22131f-6ed8-4232-9e42-c70cf4371050 None None] Join ServiceGroup membership for this service scheduler {{(pid=51429) start /opt/stack/nova/nova/service.py:199}} [ 454.191494] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191677] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.device_detach_attempts = 8 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.191712] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-ad22131f-6ed8-4232-9e42-c70cf4371050 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51429) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 454.191836] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.device_detach_timeout = 20 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.192057] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.disk_cachemodes = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.192194] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.disk_prefix = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.192359] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.enabled_perf_events = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.192522] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.file_backed_memory = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.192681] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.gid_maps = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.192854] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.hw_disk_discard = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193015] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.hw_machine_type = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193185] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_rbd_ceph_conf = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193341] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193516] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193677] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_rbd_glance_store_name = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193835] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_rbd_pool = rbd {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.193998] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_type = default {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.194166] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.images_volume_group = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.194341] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.inject_key = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.194495] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.inject_partition = -2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.194648] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.inject_password = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.194803] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.iscsi_iface = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.194977] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.iser_use_multipath = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.195151] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_bandwidth = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.195306] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_completion_timeout = 800 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.195462] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_downtime = 500 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.195614] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_downtime_delay = 75 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.195768] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_downtime_steps = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.195920] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_inbound_addr = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.196217] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_permit_auto_converge = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.196255] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_permit_post_copy = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.196404] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_scheme = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.196709] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_timeout_action = abort {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.196744] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_tunnelled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_uri = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.live_migration_with_native_tls = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.max_queues = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.mem_stats_period_seconds = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.nfs_mount_options = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.197913] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.num_aoe_discover_tries = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198179] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.num_iser_scan_tries = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198259] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.num_memory_encrypted_guests = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198351] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.num_nvme_discover_tries = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198506] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.num_pcie_ports = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198971] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.num_volume_scan_tries = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198971] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.pmem_namespaces = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.198971] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.quobyte_client_cfg = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.199205] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.199369] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rbd_connect_timeout = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.199527] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.199718] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.199866] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rbd_secret_uuid = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.200032] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rbd_user = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.200194] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.realtime_scheduler_priority = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.200377] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.remote_filesystem_transport = ssh {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.200532] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rescue_image_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.200685] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rescue_kernel_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.200857] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rescue_ramdisk_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.201042] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rng_dev_path = /dev/urandom {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.201200] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.rx_queue_size = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.201364] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.smbfs_mount_options = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.201576] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.201736] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.snapshot_compression = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.201890] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.snapshot_image_format = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.202142] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.202319] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.sparse_logical_volumes = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.202481] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.swtpm_enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.202650] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.swtpm_group = tss {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.202811] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.swtpm_user = tss {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.202977] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.sysinfo_serial = unique {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.203148] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.tx_queue_size = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.203361] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.uid_maps = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.203506] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.use_virtio_for_bridges = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.203822] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.virt_type = kvm {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.203822] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.volume_clear = zero {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.volume_clear_size = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.volume_use_multipath = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_cache_path = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_mount_group = qemu {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_mount_opts = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205264] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205264] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205264] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.vzstorage_mount_user = stack {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205431] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205619] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205786] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.auth_type = password {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.205942] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.206108] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.206266] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.206442] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.206595] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.206780] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.default_floating_pool = public {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.206936] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.207103] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.extension_sync_interval = 600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.207261] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.http_retries = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.207415] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.207569] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.207720] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.207883] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.metadata_proxy_shared_secret = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.208116] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.208211] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.ovs_bridge = br-int {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.208374] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.physnets = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.208536] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.region_name = RegionOne {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.208698] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.service_metadata_proxy = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.208852] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.209025] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.service_type = network {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.209183] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.209337] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.209486] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.209638] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.209837] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.210022] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] neutron.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.210187] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] notifications.bdms_in_notifications = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.210355] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] notifications.default_level = INFO {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.210518] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] notifications.notification_format = unversioned {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.210673] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] notifications.notify_on_state_change = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.210858] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.211061] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] pci.alias = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.211234] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] pci.device_spec = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.211392] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] pci.report_in_placement = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.211603] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.211756] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.auth_type = password {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.211924] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.auth_url = http://10.180.1.21/identity {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.212110] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.212271] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.212430] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.212586] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.212738] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.212896] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.default_domain_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213058] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.default_domain_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213212] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.domain_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213363] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.domain_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213513] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213666] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213814] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.213964] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.214127] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.214285] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.password = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.214436] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.project_domain_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.214592] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.project_domain_name = Default {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.214754] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.project_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.214920] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.project_name = service {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.215089] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.region_name = RegionOne {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.215243] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.215401] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.service_type = placement {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.215553] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.215710] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216484] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216484] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.system_scope = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216484] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216484] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.trust_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216484] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.user_domain_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216642] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.user_domain_name = Default {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216745] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.user_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.216912] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.username = placement {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.217095] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.217516] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] placement.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.217516] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.cores = 20 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.217634] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.count_usage_from_placement = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.217723] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.217907] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.injected_file_content_bytes = 10240 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.218077] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.injected_file_path_length = 255 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.218237] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.injected_files = 5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.218394] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.instances = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.218561] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.key_pairs = 100 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.218720] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.metadata_items = 128 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.218880] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.ram = 51200 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.219049] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.recheck_quota = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.219213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.server_group_members = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.219405] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] quota.server_groups = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.219635] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rdp.enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.219983] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.220220] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.220414] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.220591] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.image_metadata_prefilter = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.220758] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.220923] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.max_attempts = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.221102] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.max_placement_results = 1000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.221261] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.221435] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.query_placement_for_availability_zone = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.221612] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.query_placement_for_image_type_support = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.221765] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.221950] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] scheduler.workers = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.222213] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.222401] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.222606] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.222788] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.222955] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.223125] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.223287] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.223496] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.223665] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.host_subset_size = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.223837] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.image_properties_default_architecture = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.224008] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.224181] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.isolated_hosts = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.224340] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.isolated_images = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.224495] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.max_instances_per_host = 50 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.224668] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.224827] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.pci_in_placement = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.225014] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.225180] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.225402] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.225558] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.225715] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.225873] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.226043] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.track_instance_changes = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.226215] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.226378] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metrics.required = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.226534] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metrics.weight_multiplier = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.226691] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metrics.weight_of_unavailable = -10000.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.226852] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] metrics.weight_setting = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.227181] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.227353] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] serial_console.enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.227527] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] serial_console.port_range = 10000:20000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.227693] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.227859] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.228031] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] serial_console.serialproxy_port = 6083 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.228205] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.228401] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.auth_type = password {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.228558] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.228712] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.228873] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.229037] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.229193] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.229358] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.send_service_user_token = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.229513] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.229664] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] service_user.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.229872] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.agent_enabled = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.230066] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.230397] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.230595] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.html5proxy_host = 0.0.0.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.230814] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.html5proxy_port = 6082 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231073] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.image_compression = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231170] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.jpeg_compression = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231421] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.playback_compression = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231483] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.server_listen = 127.0.0.1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231674] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231827] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.streaming_mode = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.231982] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] spice.zlib_compression = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.232201] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] upgrade_levels.baseapi = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.232361] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] upgrade_levels.cert = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.232542] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] upgrade_levels.compute = auto {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.232692] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] upgrade_levels.conductor = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.232839] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] upgrade_levels.scheduler = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.232999] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.233189] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.auth_type = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.233342] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.233491] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.233643] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.233801] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.233951] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.234117] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.234267] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vendordata_dynamic_auth.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.234476] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.api_retry_count = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.234630] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.ca_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.234799] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.cache_prefix = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.234951] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.cluster_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.235121] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.connection_pool_size = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.235275] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.console_delay_seconds = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.235421] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.datastore_regex = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.235573] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.host_ip = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.235720] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.host_password = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.235876] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.host_port = 443 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236034] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.host_username = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236190] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236339] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.integration_bridge = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236492] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.maximum_objects = 100 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236639] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.pbm_default_policy = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236795] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.pbm_enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.236944] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.pbm_wsdl_location = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.237113] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.237265] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.serial_port_proxy_uri = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.237414] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.serial_port_service_uri = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.237573] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.task_poll_interval = 0.5 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.237723] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.use_linked_clone = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.237889] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.vnc_keymap = en-us {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.238054] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.vnc_port = 5900 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.238239] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vmware.vnc_port_total = 10000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.238390] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.auth_schemes = ['none'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.238724] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.enabled = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.238859] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.239076] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.239215] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.novncproxy_port = 6080 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.239387] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.server_listen = 127.0.0.1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.239555] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.239727] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.vencrypt_ca_certs = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.239899] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.vencrypt_client_cert = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.240064] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] vnc.vencrypt_client_key = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.240257] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.240418] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.disable_fallback_pcpu_query = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.240579] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.disable_group_policy_check_upcall = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.240757] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.240921] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.disable_rootwrap = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.241089] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.enable_numa_live_migration = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.241246] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.241397] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.241550] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.handle_virt_lifecycle_events = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.241703] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.libvirt_disable_apic = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.241859] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.never_download_image_if_on_rbd = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242033] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242210] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242369] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242528] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242683] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242839] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.242993] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.243159] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.243315] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.243495] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.243660] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.client_socket_timeout = 900 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.243818] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.default_pool_size = 1000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.243982] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.keep_alive = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.244155] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.max_header_line = 16384 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.244311] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.secure_proxy_ssl_header = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.244470] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.ssl_ca_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.244624] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.ssl_cert_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.244776] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.ssl_key_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.244934] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.tcp_keepidle = 600 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.245121] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.245286] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] zvm.ca_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.245445] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] zvm.cloud_connector_url = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.245666] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.245826] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] zvm.reachable_timeout = 300 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.246036] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.246198] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.246360] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.246518] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.246669] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.246878] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.enforce_new_defaults = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.247059] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.enforce_scope = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.247247] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.policy_default_rule = default {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.247440] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.247609] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.policy_file = policy.yaml {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.247792] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.247945] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.248109] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.248257] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.248409] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.248596] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.248772] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.248978] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.connection_string = messaging:// {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.249153] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.enabled = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.249331] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.es_doc_type = notification {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.249502] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.es_scroll_size = 10000 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.249914] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.es_scroll_time = 2m {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.249914] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.filter_error_trace = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250182] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.hmac_keys = SECRET_KEY {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250182] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.sentinel_service_name = mymaster {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250534] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.socket_timeout = 0.1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250534] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] profiler.trace_sqlalchemy = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250622] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] remote_debug.host = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250812] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] remote_debug.port = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.250998] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.251173] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.251334] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.251489] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.251649] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.251794] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.251953] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.252155] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.252322] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.252478] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.252647] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.252806] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.252975] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.253149] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.253304] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.253475] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.253631] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.253785] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.253943] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.254135] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.254294] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.254452] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.254605] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.254762] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.254924] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.255099] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.ssl = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.255265] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.255430] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.255585] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.255748] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.255910] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_rabbit.ssl_version = {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.256127] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.256294] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_notifications.retry = -1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.256490] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.256663] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_messaging_notifications.transport_url = **** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.256862] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.auth_section = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257173] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.auth_type = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257173] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.cafile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257330] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.certfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257530] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.collect_timing = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257630] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.connect_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257782] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.connect_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.257953] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.endpoint_id = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.258116] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.endpoint_override = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.258270] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.insecure = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.258417] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.keyfile = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.258565] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.max_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.258714] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.min_version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.258871] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.region_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259033] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.service_name = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259184] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.service_type = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259335] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.split_loggers = False {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259484] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.status_code_retries = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259634] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.status_code_retry_delay = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259809] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.timeout = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.259990] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.valid_interfaces = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.260157] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_limit.version = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.260350] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_reports.file_event_handler = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.260511] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.260663] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] oslo_reports.log_dir = None {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 454.260818] nova-scheduler[50382]: DEBUG oslo_service.service [None req-1de5052f-f6b2-458d-845b-2aef6a9ec2cd None None] ******************************************************************************** {{(pid=50382) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 582.382355] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Starting to schedule for instances: ['624ec0e2-c230-4469-8ffe-047f914793b1'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 582.383421] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 582.383421] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 582.383622] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 582.384271] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 582.384401] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 583.015274] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.015594] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.018058] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.024992] nova-scheduler[51431]: DEBUG oslo_db.sqlalchemy.engines [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51431) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 583.046780] nova-scheduler[51431]: DEBUG oslo_db.sqlalchemy.engines [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Parent process 50382 forked (51431) with an open database connection, which is being discarded and recreated. {{(pid=51431) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 583.057367] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.057596] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.059176] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.064751] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.064937] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.066258] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:44:21Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=0) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 583.066659] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 583.066825] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 583.066973] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Update host state with instances: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 583.067151] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.067542] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 583.067880] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.068111] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.068418] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.068615] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.068791] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.068973] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.069150] nova-scheduler[51431]: DEBUG nova.filters [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.069422] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 583.069584] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 583.069867] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Attempting to claim resources in the placement API for instance 624ec0e2-c230-4469-8ffe-047f914793b1 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 583.169473] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] [instance: 624ec0e2-c230-4469-8ffe-047f914793b1] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 583.169834] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.170064] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.170662] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-589318ae-4da4-4d37-a3b4-7b5c204a9fcf tempest-ServersTestFqdnHostnames-1996090690 tempest-ServersTestFqdnHostnames-1996090690-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.850481] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Starting to schedule for instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 583.851129] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 583.851314] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 583.851584] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 583.851961] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 583.852257] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 583.940122] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.940446] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.942160] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.946770] nova-scheduler[51429]: DEBUG oslo_db.sqlalchemy.engines [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51429) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 583.964964] nova-scheduler[51429]: DEBUG oslo_db.sqlalchemy.engines [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Parent process 50382 forked (51429) with an open database connection, which is being discarded and recreated. {{(pid=51429) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 583.975828] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.976885] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.977224] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.980968] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 583.981518] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 583.982942] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='0',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:44:59Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=1) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 583.985670] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 583.985670] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 583.985670] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 583.985904] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 583.985904] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 583.985904] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.985904] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.985904] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.986107] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.986107] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.986107] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.986193] nova-scheduler[51429]: DEBUG nova.filters [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 583.986385] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 583.988653] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 583.988653] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Attempting to claim resources in the placement API for instance ccaea0a9-59d6-456a-9885-2b90abf30abb {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 584.064931] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] [instance: ccaea0a9-59d6-456a-9885-2b90abf30abb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 584.065357] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 584.065460] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 584.065653] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9a868568-4b32-435f-a6f7-43caf74fac96 tempest-ImagesOneServerNegativeTestJSON-88470720 tempest-ImagesOneServerNegativeTestJSON-88470720-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 584.142854] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Starting to schedule for instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 584.145237] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 584.145461] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 584.145764] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 584.146161] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 584.146368] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 584.219634] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 584.219634] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 584.219634] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 584.228039] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 584.228277] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 584.228436] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 584.231873] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 584.234196] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 584.234608] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='0',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:44:59Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=1) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 584.234880] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 584.235058] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 584.235217] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 584.235381] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 584.235632] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 584.235826] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.236008] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.236206] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.236369] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.236526] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.237431] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.237651] nova-scheduler[51431]: DEBUG nova.filters [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 584.237738] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 584.237916] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 584.238126] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Attempting to claim resources in the placement API for instance b9ffb5d9-8d56-4980-9e78-1e003cd56f7e {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 584.352782] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] [instance: b9ffb5d9-8d56-4980-9e78-1e003cd56f7e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 584.353116] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 584.355053] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 584.355053] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7adad612-f524-4c15-81ed-45aff7e31009 tempest-ServersV294TestFqdnHostnames-935067380 tempest-ServersV294TestFqdnHostnames-935067380-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.548491] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Starting to schedule for instances: ['d74c7de4-5126-483f-9576-89e0007310b8'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 586.549375] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 586.549748] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 586.550233] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 586.550863] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 586.551130] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 586.607371] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.607599] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.607763] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.623655] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.625319] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.625319] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.630589] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.630844] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.631294] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_940667196dca494b839e5099008c23db='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:00Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=3) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 586.631587] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 586.631758] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 586.631919] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 586.632113] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 586.632396] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 586.632607] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.632815] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.635115] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.635628] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.641151] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.641151] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.641151] nova-scheduler[51429]: DEBUG nova.filters [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 586.641151] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 586.641698] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 586.641698] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Attempting to claim resources in the placement API for instance d74c7de4-5126-483f-9576-89e0007310b8 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 586.714175] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] [instance: d74c7de4-5126-483f-9576-89e0007310b8] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 586.717466] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 586.717690] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 586.717898] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-937591e0-6edb-4f12-92c5-69e525c19672 tempest-ServerDiagnosticsNegativeTest-683359294 tempest-ServerDiagnosticsNegativeTest-683359294-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.111166] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Starting to schedule for instances: ['50ff2169-9c1f-4f7a-b365-1949dac57f86'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 587.111337] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 587.111443] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.111682] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.111849] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.112174] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 587.164620] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.164929] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.165162] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.173185] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.173405] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.173572] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.176156] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.176468] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.176898] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_940667196dca494b839e5099008c23db='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:00Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=3) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 587.177299] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 587.177482] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 587.177645] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 587.177809] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.178075] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 587.178281] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.178461] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.178654] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.178815] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.178976] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.179154] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.179519] nova-scheduler[51431]: DEBUG nova.filters [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.179519] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 587.179670] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 587.179823] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Attempting to claim resources in the placement API for instance 50ff2169-9c1f-4f7a-b365-1949dac57f86 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 587.241193] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] [instance: 50ff2169-9c1f-4f7a-b365-1949dac57f86] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 587.241193] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.241193] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.241485] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-88dcc985-5caa-4282-a716-85ce2d8552cc tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.314967] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Starting to schedule for instances: ['294a5f91-9db2-4a43-8230-d3e6906c30f0'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 587.314967] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 587.314967] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.314967] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.315124] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.315303] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 587.378667] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.378873] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.379298] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.388779] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.388779] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.388779] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.391962] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.391962] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.392075] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='0',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:03Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=4) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 587.392075] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 587.392221] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 587.392221] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 587.392372] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.392622] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 587.392836] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.393115] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.393344] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.394201] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.394201] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.394201] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.394201] nova-scheduler[51429]: DEBUG nova.filters [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.394201] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 587.394392] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 587.394613] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Attempting to claim resources in the placement API for instance 294a5f91-9db2-4a43-8230-d3e6906c30f0 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 587.460946] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] [instance: 294a5f91-9db2-4a43-8230-d3e6906c30f0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 587.460946] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.461397] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.461397] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99798546-1953-4093-b712-db4eb0ea5e09 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.847588] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Starting to schedule for instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 587.848515] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 587.851163] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.851421] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.851662] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.851855] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 587.919063] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.919284] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.919404] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.937100] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.938437] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.938437] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.941350] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 587.941567] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 587.941951] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='0',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:03Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=5) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 587.944110] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 587.944110] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 587.944110] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 587.944320] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 587.944320] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 587.944320] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.944320] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.944320] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.944559] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.944559] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.944707] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.944870] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Starting to schedule for instances: ['19253198-cb6e-4c48-a88b-26780f3606e8'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 587.945212] nova-scheduler[51431]: DEBUG nova.filters [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 587.945285] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 587.945464] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 587.945644] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Attempting to claim resources in the placement API for instance 2545ca35-7a3f-47ed-b0de-e1bb26967379 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 587.945806] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 587.946299] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.947412] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.948721] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 587.948721] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 588.011157] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.011157] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.011157] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.040204] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.040204] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.040204] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.047354] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.048322] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.052022] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='0',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:03Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=5) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 588.052022] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 588.052188] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 588.052188] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 588.052188] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.052352] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 588.052352] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052352] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052352] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052352] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052505] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052505] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052505] nova-scheduler[51429]: DEBUG nova.filters [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 588.052505] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 588.056331] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 588.058966] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Attempting to claim resources in the placement API for instance 19253198-cb6e-4c48-a88b-26780f3606e8 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 588.059436] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] [instance: 2545ca35-7a3f-47ed-b0de-e1bb26967379] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 588.060477] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.060477] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.060477] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-18ce2558-2991-424f-9e61-8c4d378db819 tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 588.137916] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] [instance: 19253198-cb6e-4c48-a88b-26780f3606e8] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 588.140099] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 588.140099] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 588.140099] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-93123fb2-1963-4c28-b1cc-c45b27ef1fff tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 590.962267] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Starting to schedule for instances: ['91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 590.962550] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 590.964691] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.964691] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.964691] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 590.964691] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 591.022622] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.022622] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.022622] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.028957] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.029367] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.029709] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.032522] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.032868] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.033677] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:04Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=8) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 591.034260] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 591.034560] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 591.034919] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 591.035243] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 591.035644] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 591.036058] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.036351] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.036653] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.036932] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.041173] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.041173] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.041173] nova-scheduler[51431]: DEBUG nova.filters [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 591.041173] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 591.041373] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 591.041373] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Attempting to claim resources in the placement API for instance 91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 591.105906] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] [instance: 91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 591.109018] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 591.109018] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 591.109018] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-437bacfc-60af-41f1-9793-2876ddd7a707 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.022788] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Starting to schedule for instances: ['71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 602.023595] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 602.026106] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.026395] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.026628] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.026833] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 602.076614] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.077418] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.077418] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.087036] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.087036] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.087036] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.089181] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.089436] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.089874] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='0',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='9',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:13Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=9) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 602.090568] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 602.090789] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 602.091257] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 602.091479] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.091915] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 602.091991] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.092239] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.092382] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.092558] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.092719] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.093789] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.093789] nova-scheduler[51429]: DEBUG nova.filters [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.093789] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 602.093789] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 602.093932] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Attempting to claim resources in the placement API for instance 71554abb-780c-4681-909f-8ff93712c82e {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 602.151342] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] [instance: 71554abb-780c-4681-909f-8ff93712c82e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 602.151911] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.151911] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.152151] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c52b5a55-3c9f-48b8-a97f-1445f3bd7286 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.651930] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Starting to schedule for instances: ['789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 602.652393] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 602.652588] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.652834] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.653074] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 602.653289] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 602.711991] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.712290] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.712460] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.720602] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.720816] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.721034] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.723524] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.723726] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.724920] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 602.725061] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 602.725061] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 602.725061] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 602.725219] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 602.725219] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 602.725317] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.725491] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.725682] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.725840] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.726046] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.726187] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.726348] nova-scheduler[51431]: DEBUG nova.filters [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 602.726505] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 602.726668] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 602.726843] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Attempting to claim resources in the placement API for instance 789a3358-bc70-44a5-bb2f-4fc2f1ff9116 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 602.787315] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] [instance: 789a3358-bc70-44a5-bb2f-4fc2f1ff9116] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 602.787451] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 602.787801] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 602.787919] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-11c043ea-2ab6-4554-94b6-49c617be9c12 tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.766400] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Starting to schedule for instances: ['14e395c0-3650-40d6-82f1-1bd8f0b29984'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 603.766400] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 603.766400] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.766400] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.766400] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 603.766846] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 603.826281] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.826510] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.826678] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.834759] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.834857] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.835028] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.837675] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.837879] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.838268] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 603.838546] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 603.838712] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 603.838867] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 603.839122] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 603.839380] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 603.839483] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.839662] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.840028] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.840223] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.840886] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.841733] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.841733] nova-scheduler[51429]: DEBUG nova.filters [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 603.841733] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 603.841733] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 603.841870] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Attempting to claim resources in the placement API for instance 14e395c0-3650-40d6-82f1-1bd8f0b29984 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 603.912039] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] [instance: 14e395c0-3650-40d6-82f1-1bd8f0b29984] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 603.912422] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 603.912660] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 603.912978] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21bb3429-6173-4677-9a8c-712e7483772d tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.124137] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Starting to schedule for instances: ['3be005c8-8cbe-4c3a-9478-840167b99e97'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 607.124897] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 607.125059] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.125263] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.125476] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 607.125680] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 607.182770] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.183052] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.183278] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.193197] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.193197] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.193197] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.197620] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 607.197620] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 607.197852] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 607.197938] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 607.197938] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 607.198035] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 607.198035] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 607.198035] nova-scheduler[51431]: DEBUG nova.filters [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 607.199032] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 61.04687 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 607.199032] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 607.199032] nova-scheduler[51431]: INFO nova.filters [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Filter ComputeFilter returned 0 hosts [ 607.199158] nova-scheduler[51431]: DEBUG nova.filters [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Filtering removed all hosts for the request with instance ID '3be005c8-8cbe-4c3a-9478-840167b99e97'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 607.199202] nova-scheduler[51431]: INFO nova.filters [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Filtering removed all hosts for the request with instance ID '3be005c8-8cbe-4c3a-9478-840167b99e97'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 607.199340] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 607.199500] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-078d50d3-e5f3-4888-bc0a-d9efbfb5db22 tempest-VolumesAssistedSnapshotsTest-1277997804 tempest-VolumesAssistedSnapshotsTest-1277997804-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 608.618079] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Starting to schedule for instances: ['6674867a-80c3-4e83-9b1e-134dc6339f3c'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 608.618079] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 608.618079] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.618079] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.618079] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 608.618575] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 608.658366] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.658653] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.658849] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.670499] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.670872] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.671091] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.673748] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 608.674023] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 608.674454] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 608.674804] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 608.675021] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 608.675218] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 608.675412] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 608.675716] nova-scheduler[51429]: DEBUG nova.filters [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 608.676984] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 62.524802 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 608.676984] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 608.676984] nova-scheduler[51429]: INFO nova.filters [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Filter ComputeFilter returned 0 hosts [ 608.676984] nova-scheduler[51429]: DEBUG nova.filters [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Filtering removed all hosts for the request with instance ID '6674867a-80c3-4e83-9b1e-134dc6339f3c'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 608.676984] nova-scheduler[51429]: INFO nova.filters [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Filtering removed all hosts for the request with instance ID '6674867a-80c3-4e83-9b1e-134dc6339f3c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 608.677225] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 608.677225] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f5fbf8fe-f75c-454a-bd25-2b6c63d2a371 tempest-ImagesNegativeTestJSON-423402721 tempest-ImagesNegativeTestJSON-423402721-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 613.650890] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Starting to schedule for instances: ['e8a4d12f-e119-4b71-ac84-e7f8c09aa75f'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 613.651228] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 613.651397] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.651694] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.651768] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.651953] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 613.735992] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.736658] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.736658] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.748585] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.749322] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.749322] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.751636] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.751839] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.752408] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 613.752533] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 613.752678] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 613.752830] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 613.752994] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.753268] nova-scheduler[51431]: DEBUG nova.filters [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 613.753724] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 67.602353 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 613.753724] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 613.753833] nova-scheduler[51431]: INFO nova.filters [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filter ComputeFilter returned 0 hosts [ 613.753920] nova-scheduler[51431]: DEBUG nova.filters [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filtering removed all hosts for the request with instance ID 'e8a4d12f-e119-4b71-ac84-e7f8c09aa75f'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 613.754066] nova-scheduler[51431]: INFO nova.filters [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filtering removed all hosts for the request with instance ID 'e8a4d12f-e119-4b71-ac84-e7f8c09aa75f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 613.754208] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 613.754348] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1b47de7d-1f62-4d90-bc2a-a2badc56b801 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 614.351458] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Starting to schedule for instances: ['b9cda1b4-4e6e-488e-a43f-9f37ae2feee5'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 614.351825] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 614.352054] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 614.355032] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 614.355032] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 614.355032] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 614.401927] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 614.402911] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 614.402911] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 614.410035] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 614.410860] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 614.411016] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 614.416731] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 614.416731] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 614.416891] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 614.416965] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 614.416965] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 614.416965] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 614.417118] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 614.417118] nova-scheduler[51429]: DEBUG nova.filters [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 614.417118] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 68.264665 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 614.417118] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 614.417118] nova-scheduler[51429]: INFO nova.filters [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filter ComputeFilter returned 0 hosts [ 614.417341] nova-scheduler[51429]: DEBUG nova.filters [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtering removed all hosts for the request with instance ID 'b9cda1b4-4e6e-488e-a43f-9f37ae2feee5'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 614.417341] nova-scheduler[51429]: INFO nova.filters [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtering removed all hosts for the request with instance ID 'b9cda1b4-4e6e-488e-a43f-9f37ae2feee5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 614.417341] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 614.417341] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7b4071a1-2eaa-43ff-81b7-b9a91078cf46 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 615.385057] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Starting to schedule for instances: ['d5f83b3a-36b2-4c83-9858-0a74e48e00a3'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 615.385452] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 615.385612] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.385792] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.385993] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 615.386197] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 615.435388] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.435610] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.435774] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.443339] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.443680] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.443830] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.446195] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 615.446427] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 615.446828] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 615.447188] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 615.447406] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 615.447597] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 615.447819] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 615.448168] nova-scheduler[51431]: DEBUG nova.filters [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 615.448416] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 69.297263 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 615.448607] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 615.448794] nova-scheduler[51431]: INFO nova.filters [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Filter ComputeFilter returned 0 hosts [ 615.452157] nova-scheduler[51431]: DEBUG nova.filters [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Filtering removed all hosts for the request with instance ID 'd5f83b3a-36b2-4c83-9858-0a74e48e00a3'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 615.452353] nova-scheduler[51431]: INFO nova.filters [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Filtering removed all hosts for the request with instance ID 'd5f83b3a-36b2-4c83-9858-0a74e48e00a3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 615.452520] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 615.452672] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-835b0354-fd3d-4cf5-ac66-a9ba15ebe788 tempest-ServersWithSpecificFlavorTestJSON-1898801755 tempest-ServersWithSpecificFlavorTestJSON-1898801755-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 616.918896] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Starting to schedule for instances: ['5b188e02-5748-47ae-8e07-947bc1b751b6'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 616.918896] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 616.920202] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.920503] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.920717] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.920931] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 616.974254] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.974365] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.974878] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.984934] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.989037] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Starting to schedule for instances: ['784b2226-7bd1-464e-b067-3e1a8ede0380'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 616.989037] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 616.989806] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.989806] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.989909] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.989909] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.989909] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 616.989909] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 616.990062] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 616.990062] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 616.990162] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 616.990234] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 616.990234] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 616.990345] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 616.990418] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 616.991129] nova-scheduler[51429]: DEBUG nova.filters [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 616.991129] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 70.839766 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 616.991129] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 616.991268] nova-scheduler[51429]: INFO nova.filters [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filter ComputeFilter returned 0 hosts [ 616.991668] nova-scheduler[51429]: DEBUG nova.filters [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filtering removed all hosts for the request with instance ID '5b188e02-5748-47ae-8e07-947bc1b751b6'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 616.991668] nova-scheduler[51429]: INFO nova.filters [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filtering removed all hosts for the request with instance ID '5b188e02-5748-47ae-8e07-947bc1b751b6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 616.991668] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 616.991801] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-c16939da-41f3-4d0c-af99-036342e57d61 tempest-ServersAdminTestJSON-401499959 tempest-ServersAdminTestJSON-401499959-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 617.044697] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.044697] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.044697] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.051699] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.051912] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.052116] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.054459] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 617.054459] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 617.055161] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 617.055357] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 617.055357] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 617.055777] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 617.055777] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 617.055995] nova-scheduler[51431]: DEBUG nova.filters [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 617.056363] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 70.905096 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 617.056427] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 617.056562] nova-scheduler[51431]: INFO nova.filters [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Filter ComputeFilter returned 0 hosts [ 617.056908] nova-scheduler[51431]: DEBUG nova.filters [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Filtering removed all hosts for the request with instance ID '784b2226-7bd1-464e-b067-3e1a8ede0380'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 617.056908] nova-scheduler[51431]: INFO nova.filters [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Filtering removed all hosts for the request with instance ID '784b2226-7bd1-464e-b067-3e1a8ede0380'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 617.057045] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 617.057154] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7edc95a2-4abe-49a8-82d4-276b8bcad543 tempest-InstanceActionsV221TestJSON-1281874576 tempest-InstanceActionsV221TestJSON-1281874576-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 620.622046] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Starting to schedule for instances: ['4fc66c3a-ce44-40b1-a7c5-a55ac6ae2e2e'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 620.622046] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 620.622046] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.624355] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.624355] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.624355] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 620.673435] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.673671] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.673840] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.681450] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.682407] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.682407] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.687189] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.687418] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.687938] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 620.688649] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 620.688835] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 620.689046] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 620.689224] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.689484] nova-scheduler[51429]: DEBUG nova.filters [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 620.689697] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 74.538568 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 620.689889] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 620.690077] nova-scheduler[51429]: INFO nova.filters [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filter ComputeFilter returned 0 hosts [ 620.690234] nova-scheduler[51429]: DEBUG nova.filters [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filtering removed all hosts for the request with instance ID '4fc66c3a-ce44-40b1-a7c5-a55ac6ae2e2e'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 620.690519] nova-scheduler[51429]: INFO nova.filters [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filtering removed all hosts for the request with instance ID '4fc66c3a-ce44-40b1-a7c5-a55ac6ae2e2e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 620.690519] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 620.690687] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b0eec7d6-ef58-47fc-8e61-ba5f7e11fb19 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 621.047669] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Starting to schedule for instances: ['21bae61a-3f84-4fc2-9775-d29843e16cda'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 621.048406] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 621.048513] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.048719] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.048924] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 621.049129] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 621.099340] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.099879] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.099879] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.106886] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.107114] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.107472] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.112407] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 621.112617] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 621.112988] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 621.113305] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 621.113472] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 621.113798] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 621.113994] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 621.114394] nova-scheduler[51431]: DEBUG nova.filters [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 621.115031] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 74.963481 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 621.115031] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 621.115031] nova-scheduler[51431]: INFO nova.filters [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Filter ComputeFilter returned 0 hosts [ 621.115346] nova-scheduler[51431]: DEBUG nova.filters [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Filtering removed all hosts for the request with instance ID '21bae61a-3f84-4fc2-9775-d29843e16cda'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 621.115505] nova-scheduler[51431]: INFO nova.filters [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Filtering removed all hosts for the request with instance ID '21bae61a-3f84-4fc2-9775-d29843e16cda'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 621.115659] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 621.115819] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9d3d64e5-f623-45f7-94a2-0b7f4c481555 tempest-ServerPasswordTestJSON-218453344 tempest-ServerPasswordTestJSON-218453344-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 622.217527] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Starting to schedule for instances: ['e83917eb-196f-49bb-9f76-762efc6bfa4c'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 622.217527] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 622.217527] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.217859] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.218859] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 622.218859] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 622.285950] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.285950] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.285950] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.293247] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.293574] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.293723] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.296223] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 622.296482] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 622.296888] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 622.297196] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 622.297371] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 622.297562] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 622.297745] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 622.298021] nova-scheduler[51429]: DEBUG nova.filters [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 622.298238] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 76.147106 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 622.298399] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 622.298569] nova-scheduler[51429]: INFO nova.filters [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter ComputeFilter returned 0 hosts [ 622.298722] nova-scheduler[51429]: DEBUG nova.filters [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filtering removed all hosts for the request with instance ID 'e83917eb-196f-49bb-9f76-762efc6bfa4c'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 622.298869] nova-scheduler[51429]: INFO nova.filters [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filtering removed all hosts for the request with instance ID 'e83917eb-196f-49bb-9f76-762efc6bfa4c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 622.300632] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 622.300880] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7d6da4f6-bec8-4766-a3a4-63365cd64a35 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 623.078663] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Starting to schedule for instances: ['19283ac4-6955-40ee-9ce7-edec4bb5c2a7'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 623.078960] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 623.079128] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.079308] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.079822] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.079822] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 623.128854] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.129717] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.129717] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.131644] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Starting to schedule for instances: ['06762eff-38d6-462e-9794-d842af3d7f15'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 623.131929] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 623.133018] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.133018] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.133018] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 623.133018] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 623.139903] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.140141] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.140307] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.145026] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.145244] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.145624] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 623.149467] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 623.149608] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 623.149804] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 623.150009] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.151274] nova-scheduler[51431]: DEBUG nova.filters [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 623.151530] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 77.000373 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 623.151711] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 623.151884] nova-scheduler[51431]: INFO nova.filters [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filter ComputeFilter returned 0 hosts [ 623.152051] nova-scheduler[51431]: DEBUG nova.filters [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filtering removed all hosts for the request with instance ID '19283ac4-6955-40ee-9ce7-edec4bb5c2a7'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 623.152197] nova-scheduler[51431]: INFO nova.filters [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filtering removed all hosts for the request with instance ID '19283ac4-6955-40ee-9ce7-edec4bb5c2a7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 623.152397] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 623.152488] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ceccb36b-f762-44a1-b13d-cd13decfbe18 tempest-ListImageFiltersTestJSON-2121114852 tempest-ListImageFiltersTestJSON-2121114852-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 623.189874] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.190138] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.190311] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.197966] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.197966] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.197966] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.199673] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 623.200030] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 623.200308] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 623.200855] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 623.200855] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 623.200994] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 623.201075] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 623.201311] nova-scheduler[51429]: DEBUG nova.filters [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 623.201517] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 77.050395 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 623.201698] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 623.201867] nova-scheduler[51429]: INFO nova.filters [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filter ComputeFilter returned 0 hosts [ 623.202031] nova-scheduler[51429]: DEBUG nova.filters [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtering removed all hosts for the request with instance ID '06762eff-38d6-462e-9794-d842af3d7f15'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 623.202175] nova-scheduler[51429]: INFO nova.filters [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtering removed all hosts for the request with instance ID '06762eff-38d6-462e-9794-d842af3d7f15'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 623.205036] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 623.205036] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f3947a42-070f-4fc6-985c-342fe6425bea tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 625.401655] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Starting to schedule for instances: ['4fa6e54a-7bf9-4d2f-8255-a4829d11afdd'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 625.401969] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 625.403191] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.403415] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.403627] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.405074] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 625.449132] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.449478] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.449626] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.463766] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.463766] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.463766] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.464103] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.464454] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.464719] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 625.465661] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 625.465661] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 625.465661] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 625.467281] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.467281] nova-scheduler[51431]: DEBUG nova.filters [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 625.467281] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 79.315189 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 625.467281] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 625.467281] nova-scheduler[51431]: INFO nova.filters [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filter ComputeFilter returned 0 hosts [ 625.467858] nova-scheduler[51431]: DEBUG nova.filters [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtering removed all hosts for the request with instance ID '4fa6e54a-7bf9-4d2f-8255-a4829d11afdd'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 625.467858] nova-scheduler[51431]: INFO nova.filters [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtering removed all hosts for the request with instance ID '4fa6e54a-7bf9-4d2f-8255-a4829d11afdd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 625.467858] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 625.467961] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-0dea5a8e-d6a1-4821-ac08-464f6436a9d8 tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 627.730754] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Starting to schedule for instances: ['0d3a33ba-9948-46b0-a780-05187b3b9e2a'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.731378] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.731569] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.731877] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.731957] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.732188] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.758915] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Starting to schedule for instances: ['53171b82-87bd-4747-8c44-f4b96944576b'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.759655] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.759896] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.760132] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.760655] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.760923] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.789419] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.789419] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.789599] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.799687] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.800030] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.800303] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.804460] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.804460] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.804604] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.804675] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.804675] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.804675] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.804822] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.804822] nova-scheduler[51429]: DEBUG nova.filters [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.806247] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 81.65389 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 627.806247] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 627.806247] nova-scheduler[51429]: INFO nova.filters [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Filter ComputeFilter returned 0 hosts [ 627.806247] nova-scheduler[51429]: DEBUG nova.filters [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Filtering removed all hosts for the request with instance ID '0d3a33ba-9948-46b0-a780-05187b3b9e2a'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 627.806247] nova-scheduler[51429]: INFO nova.filters [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Filtering removed all hosts for the request with instance ID '0d3a33ba-9948-46b0-a780-05187b3b9e2a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 627.806457] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.806457] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99e8ec92-c08d-429a-b60e-0b7011d6f382 tempest-InstanceActionsTestJSON-128812469 tempest-InstanceActionsTestJSON-128812469-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 627.822520] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.822520] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.822520] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.828658] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.829019] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.829150] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.833115] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.833378] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.834223] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.834352] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.834352] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.834352] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.834508] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.834708] nova-scheduler[51431]: DEBUG nova.filters [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.835820] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 81.683788 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 627.835820] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 627.835820] nova-scheduler[51431]: INFO nova.filters [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filter ComputeFilter returned 0 hosts [ 627.835820] nova-scheduler[51431]: DEBUG nova.filters [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtering removed all hosts for the request with instance ID '53171b82-87bd-4747-8c44-f4b96944576b'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 627.835820] nova-scheduler[51431]: INFO nova.filters [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtering removed all hosts for the request with instance ID '53171b82-87bd-4747-8c44-f4b96944576b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 627.836068] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.836068] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8b9af34f-00a8-482b-8076-e963649838db tempest-ListServerFiltersTestJSON-319734708 tempest-ListServerFiltersTestJSON-319734708-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 632.416990] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Starting to schedule for instances: ['37ead82c-5149-4ca4-b6d1-1c6a9b7a1d8f'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 632.417310] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 632.417472] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 632.417653] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 632.417889] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 632.420492] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 632.482781] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.483009] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 632.483180] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.491443] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.491443] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 632.491443] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.493858] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 632.493858] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 632.493999] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 632.494182] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 632.494348] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 632.494535] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 632.494704] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 632.494966] nova-scheduler[51429]: DEBUG nova.filters [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 632.497649] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 86.344043 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 632.497649] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 632.497649] nova-scheduler[51429]: INFO nova.filters [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filter ComputeFilter returned 0 hosts [ 632.497649] nova-scheduler[51429]: DEBUG nova.filters [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtering removed all hosts for the request with instance ID '37ead82c-5149-4ca4-b6d1-1c6a9b7a1d8f'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 632.497649] nova-scheduler[51429]: INFO nova.filters [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtering removed all hosts for the request with instance ID '37ead82c-5149-4ca4-b6d1-1c6a9b7a1d8f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 632.498022] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 632.498022] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5ecea07c-69c2-47e9-b1f7-b9b17254da86 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 633.408953] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['37202d88-1a7e-4269-8b42-6f37a277fde0'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 633.409284] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 633.409593] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.409671] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.409881] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.410527] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 633.451313] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.452040] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.452314] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.459134] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.459432] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.459633] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.466150] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.466150] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.466262] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 633.469915] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 633.469915] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 633.469915] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 633.470153] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.470153] nova-scheduler[51431]: DEBUG nova.filters [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 633.470153] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 87.316765 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 633.470153] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 633.470153] nova-scheduler[51431]: INFO nova.filters [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 0 hosts [ 633.470342] nova-scheduler[51431]: DEBUG nova.filters [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '37202d88-1a7e-4269-8b42-6f37a277fde0'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 633.470342] nova-scheduler[51431]: INFO nova.filters [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '37202d88-1a7e-4269-8b42-6f37a277fde0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 633.470342] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 633.470342] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8cbcf482-fe29-4c89-8d60-53e3f84ad15b tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 639.464050] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Starting to schedule for instances: ['e65824b0-5754-4a40-bee8-cd91c606c230'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 639.464271] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 639.464536] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.464614] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.464873] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 639.464994] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 639.519200] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.519432] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.519610] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.527474] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.527474] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.527637] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.530298] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 639.530493] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 639.531184] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='0',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:18Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 639.531315] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 639.531357] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 639.531537] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Update host state with instances: ['624ec0e2-c230-4469-8ffe-047f914793b1', 'ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 639.531651] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 639.531918] nova-scheduler[51429]: DEBUG nova.filters [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 639.532156] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 93.380987 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 639.532332] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 639.535336] nova-scheduler[51429]: INFO nova.filters [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Filter ComputeFilter returned 0 hosts [ 639.535336] nova-scheduler[51429]: DEBUG nova.filters [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Filtering removed all hosts for the request with instance ID 'e65824b0-5754-4a40-bee8-cd91c606c230'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 639.535336] nova-scheduler[51429]: INFO nova.filters [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Filtering removed all hosts for the request with instance ID 'e65824b0-5754-4a40-bee8-cd91c606c230'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 639.535336] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 639.535336] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-4b1cc2bd-38ef-4d29-878c-e55666319fea tempest-ServerRescueTestJSONUnderV235-1848828535 tempest-ServerRescueTestJSONUnderV235-1848828535-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 642.187144] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Starting to schedule for instances: ['f48a7d41-da2f-455f-a69d-6a0fe01afbf1'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 642.187144] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 642.187144] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.187144] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.187144] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.187482] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 642.258260] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.258495] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.258665] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.268747] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.268966] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.269707] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.275432] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.275647] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.276036] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 642.276334] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 642.276498] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 642.276652] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 642.276820] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.277084] nova-scheduler[51431]: DEBUG nova.filters [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 642.277288] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 96.126169 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 642.277657] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 642.277657] nova-scheduler[51431]: INFO nova.filters [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Filter ComputeFilter returned 0 hosts [ 642.279744] nova-scheduler[51431]: DEBUG nova.filters [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Filtering removed all hosts for the request with instance ID 'f48a7d41-da2f-455f-a69d-6a0fe01afbf1'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 642.279744] nova-scheduler[51431]: INFO nova.filters [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Filtering removed all hosts for the request with instance ID 'f48a7d41-da2f-455f-a69d-6a0fe01afbf1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 642.279744] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 642.279744] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1546547c-32db-4c36-af81-049a458fa4b8 tempest-ServerAddressesTestJSON-29294824 tempest-ServerAddressesTestJSON-29294824-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 644.661347] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Starting to schedule for instances: ['bb971e86-ccde-4b55-b293-9b29678fa4ba'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 644.661768] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 644.661839] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.667210] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.667210] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.667210] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 644.724738] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.725146] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.725146] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.739349] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.739611] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.739781] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.742537] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.742748] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.743175] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 644.743479] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 644.743648] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 644.744134] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 644.744134] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.744356] nova-scheduler[51429]: DEBUG nova.filters [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 644.744445] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 98.593326 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 644.744605] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 644.744747] nova-scheduler[51429]: INFO nova.filters [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Filter ComputeFilter returned 0 hosts [ 644.744889] nova-scheduler[51429]: DEBUG nova.filters [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Filtering removed all hosts for the request with instance ID 'bb971e86-ccde-4b55-b293-9b29678fa4ba'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 644.746053] nova-scheduler[51429]: INFO nova.filters [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Filtering removed all hosts for the request with instance ID 'bb971e86-ccde-4b55-b293-9b29678fa4ba'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 644.746270] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 644.746430] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-1d838124-5d21-4d49-88f0-f20c2841b536 tempest-AttachInterfacesUnderV243Test-898182292 tempest-AttachInterfacesUnderV243Test-898182292-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 645.869364] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['62340310-446b-4356-9509-d4b5824ff0e8'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 645.869590] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 645.869813] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 645.870338] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 645.870338] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 645.870338] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 645.910739] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 645.912194] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 645.912194] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 645.919548] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 645.919548] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 645.919548] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 645.920819] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 645.921566] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 645.922198] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 645.922434] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 645.922434] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 645.922434] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 645.922593] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 645.922593] nova-scheduler[51431]: DEBUG nova.filters [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 645.922694] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 99.771578 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 645.922852] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 645.923117] nova-scheduler[51431]: INFO nova.filters [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 0 hosts [ 645.923293] nova-scheduler[51431]: DEBUG nova.filters [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '62340310-446b-4356-9509-d4b5824ff0e8'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 645.923436] nova-scheduler[51431]: INFO nova.filters [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '62340310-446b-4356-9509-d4b5824ff0e8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 645.923617] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 645.923741] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3e8d2f54-c465-4cf3-9852-b5a8664a8840 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 648.235960] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting to schedule for instances: ['4a646d2b-6443-42b4-93f6-cfe4d94b554d'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 648.236264] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 648.236427] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.236779] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.236859] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.237598] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 648.288314] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.289321] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.290373] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.303103] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.303103] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.303103] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.303284] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.303490] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.303873] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 648.304271] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with aggregates: [Aggregate(created_at=2024-08-31T09:45:58Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-35000819',updated_at=None,uuid=79d4aff6-04ef-44b0-b35a-1bfc7a359d3d)] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 648.304460] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 648.304626] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 648.304788] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.305179] nova-scheduler[51429]: DEBUG nova.filters [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 648.308766] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 102.154176 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 648.308766] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 648.308766] nova-scheduler[51429]: INFO nova.filters [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ComputeFilter returned 0 hosts [ 648.308766] nova-scheduler[51429]: DEBUG nova.filters [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtering removed all hosts for the request with instance ID '4a646d2b-6443-42b4-93f6-cfe4d94b554d'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 648.308766] nova-scheduler[51429]: INFO nova.filters [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtering removed all hosts for the request with instance ID '4a646d2b-6443-42b4-93f6-cfe4d94b554d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 648.308966] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 648.308966] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e44a1828-442d-4c83-aebf-9793ab6b956b tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 650.452490] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Starting to schedule for instances: ['e98d86a5-a014-4209-a820-1e32aff1e81f'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 650.452842] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 650.452967] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.453479] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.453660] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.453895] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 650.498536] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.498812] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.499024] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.505776] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.506214] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.506444] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.508597] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.508843] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.509262] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 650.509553] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 650.509723] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 650.509903] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 650.510089] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.510339] nova-scheduler[51431]: DEBUG nova.filters [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 650.510555] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 104.359425 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 650.510701] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 650.510858] nova-scheduler[51431]: INFO nova.filters [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Filter ComputeFilter returned 0 hosts [ 650.511360] nova-scheduler[51431]: DEBUG nova.filters [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Filtering removed all hosts for the request with instance ID 'e98d86a5-a014-4209-a820-1e32aff1e81f'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 650.511360] nova-scheduler[51431]: INFO nova.filters [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Filtering removed all hosts for the request with instance ID 'e98d86a5-a014-4209-a820-1e32aff1e81f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 650.511360] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 650.511526] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-be2726bf-b255-408c-8a2b-c8a57c457253 tempest-ServersAaction247Test-2141225313 tempest-ServersAaction247Test-2141225313-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 651.695195] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Starting to schedule for instances: ['13b7ceaa-dfa5-4a82-85ba-a8c0b112d3ab'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 651.696513] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 651.696513] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.696513] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.697210] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.697389] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 651.751110] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.751588] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.752549] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.761193] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.761193] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.761193] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.765206] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.765206] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.765413] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 651.765558] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 651.765558] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 651.765558] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 651.766252] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.766252] nova-scheduler[51429]: DEBUG nova.filters [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 651.766252] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 105.614449 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 651.766252] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 651.766252] nova-scheduler[51429]: INFO nova.filters [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filter ComputeFilter returned 0 hosts [ 651.766570] nova-scheduler[51429]: DEBUG nova.filters [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtering removed all hosts for the request with instance ID '13b7ceaa-dfa5-4a82-85ba-a8c0b112d3ab'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 651.766570] nova-scheduler[51429]: INFO nova.filters [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtering removed all hosts for the request with instance ID '13b7ceaa-dfa5-4a82-85ba-a8c0b112d3ab'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 651.766570] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 651.766570] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-a9fc1222-d9a5-4897-8d3d-a647a1eed6e7 tempest-AttachInterfacesTestJSON-1140162678 tempest-AttachInterfacesTestJSON-1140162678-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 656.320718] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['86c4ce9e-9408-4c8c-8169-6997ae7d6fed'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 656.321373] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 656.322416] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.322416] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.322416] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.322416] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 656.371666] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.371907] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.372097] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.380455] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.380695] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.381163] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.383666] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.383962] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.385043] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0c870ef0323546079b6471bb30e9eb36='0',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:45:57Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 656.385128] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 656.385128] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 656.385287] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 656.385405] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.385655] nova-scheduler[51431]: DEBUG nova.filters [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 656.385862] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 110.234737 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 656.386039] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 656.386181] nova-scheduler[51431]: INFO nova.filters [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 0 hosts [ 656.387221] nova-scheduler[51431]: DEBUG nova.filters [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '86c4ce9e-9408-4c8c-8169-6997ae7d6fed'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 656.387403] nova-scheduler[51431]: INFO nova.filters [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '86c4ce9e-9408-4c8c-8169-6997ae7d6fed'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 656.387565] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 656.387732] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-367fe66d-373a-48e4-b444-5bb525ca396f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 658.034027] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.034027] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.034027] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.034027] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.034027] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.034649] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.034863] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.003s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.035281] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.037109] nova-scheduler[51429]: INFO nova.scheduler.host_manager [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 658.037308] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.039278] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.039631] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.044482] nova-scheduler[51431]: INFO nova.scheduler.host_manager [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 658.044674] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd5d79f3-5124-43ae-8825-16d5faa56f00 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.010s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.797302] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Starting to schedule for instances: ['12935365-8280-4742-a407-906c86a31c36'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 658.799231] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 658.799231] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.799231] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.799231] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 658.800268] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 658.852172] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.852513] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.852822] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.865244] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.865678] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.866124] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.869512] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 658.869853] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 658.870698] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 658.870846] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 658.870846] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 658.870846] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 658.871048] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 658.871728] nova-scheduler[51429]: DEBUG nova.filters [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 658.871728] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 112.72027 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 658.871728] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 658.871728] nova-scheduler[51429]: INFO nova.filters [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Filter ComputeFilter returned 0 hosts [ 658.871910] nova-scheduler[51429]: DEBUG nova.filters [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Filtering removed all hosts for the request with instance ID '12935365-8280-4742-a407-906c86a31c36'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 658.871983] nova-scheduler[51429]: INFO nova.filters [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Filtering removed all hosts for the request with instance ID '12935365-8280-4742-a407-906c86a31c36'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 658.872138] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 658.872280] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-55cbad79-7796-4ccb-a030-24f23ef4fea6 tempest-AttachInterfacesV270Test-1647516756 tempest-AttachInterfacesV270Test-1647516756-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.586607] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting to schedule for instances: ['1eb64caf-bb75-4c74-86da-3bb2189c29af'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.586910] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.587228] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.587675] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.587897] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.588506] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.640177] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.640177] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.640177] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.649050] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.649050] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.649050] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.651246] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.651942] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.652285] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.653055] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.653055] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.653179] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.653285] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.653537] nova-scheduler[51431]: DEBUG nova.filters [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.654473] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 114.502624 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.654473] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 660.654473] nova-scheduler[51431]: INFO nova.filters [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ComputeFilter returned 0 hosts [ 660.654473] nova-scheduler[51431]: DEBUG nova.filters [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtering removed all hosts for the request with instance ID '1eb64caf-bb75-4c74-86da-3bb2189c29af'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.654473] nova-scheduler[51431]: INFO nova.filters [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtering removed all hosts for the request with instance ID '1eb64caf-bb75-4c74-86da-3bb2189c29af'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.654697] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.654737] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-8270dfcb-fe15-4309-a1bf-593722500bc3 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 664.734014] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Starting to schedule for instances: ['52b4364d-69ad-47ca-92f9-86300e2431b3'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 664.735693] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 664.735693] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.735693] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.738036] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.738036] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 664.783726] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.784142] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.784142] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.799246] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.799246] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.799246] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.801922] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.802153] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.802519] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 664.802806] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 664.802971] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 664.803153] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 664.803361] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.803628] nova-scheduler[51429]: DEBUG nova.filters [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.803839] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 118.652712 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 664.803997] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 664.804175] nova-scheduler[51429]: INFO nova.filters [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter ComputeFilter returned 0 hosts [ 664.804325] nova-scheduler[51429]: DEBUG nova.filters [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filtering removed all hosts for the request with instance ID '52b4364d-69ad-47ca-92f9-86300e2431b3'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 664.804463] nova-scheduler[51429]: INFO nova.filters [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filtering removed all hosts for the request with instance ID '52b4364d-69ad-47ca-92f9-86300e2431b3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 664.804612] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.805352] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e259c3f3-4bc1-4d93-a0f2-8458944572bb tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 664.956403] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['6b4f2e71-86e4-4076-b7ef-b7ec4793bfbf'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 664.958554] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 664.958554] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.958554] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.958554] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.958554] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 665.004675] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.004912] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.005139] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.012807] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.015324] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.015324] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.016202] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.016424] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.016813] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 665.017126] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 665.017304] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 665.017465] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 665.017629] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.017891] nova-scheduler[51431]: DEBUG nova.filters [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 665.018120] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 118.866975 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 665.018278] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 665.018438] nova-scheduler[51431]: INFO nova.filters [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 0 hosts [ 665.018589] nova-scheduler[51431]: DEBUG nova.filters [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '6b4f2e71-86e4-4076-b7ef-b7ec4793bfbf'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 665.018729] nova-scheduler[51431]: INFO nova.filters [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '6b4f2e71-86e4-4076-b7ef-b7ec4793bfbf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 665.018898] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 665.019102] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ac80d378-68b3-49dc-8d56-9b48820a546a tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 665.852409] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Starting to schedule for instances: ['12d8f38e-2bb8-4f33-834a-7ac7370699b1'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 665.853505] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 665.854248] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.854448] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.854653] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 665.854842] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 665.903171] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.903313] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.903527] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.909736] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.909972] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.910186] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.912375] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 665.912571] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 665.912926] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 665.913225] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 665.913499] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 44, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 665.913559] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 665.913767] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 665.913951] nova-scheduler[51429]: DEBUG nova.filters [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 665.914189] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:44:22. Elapsed time is 119.763037 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 665.914349] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 665.914493] nova-scheduler[51429]: INFO nova.filters [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Filter ComputeFilter returned 0 hosts [ 665.914645] nova-scheduler[51429]: DEBUG nova.filters [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Filtering removed all hosts for the request with instance ID '12d8f38e-2bb8-4f33-834a-7ac7370699b1'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 665.914796] nova-scheduler[51429]: INFO nova.filters [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Filtering removed all hosts for the request with instance ID '12d8f38e-2bb8-4f33-834a-7ac7370699b1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 665.914957] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 665.915132] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-aa1a9109-4671-4f79-868e-3334c2e54dc4 tempest-ServerAddressesNegativeTestJSON-1475618111 tempest-ServerAddressesNegativeTestJSON-1475618111-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 667.261276] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Starting to schedule for instances: ['238825ed-3715-444c-be7c-f42f3884df7c'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 667.261710] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 667.261935] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.262136] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.262330] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.262505] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 667.322679] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.323320] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.323320] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.330505] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Starting to schedule for instances: ['2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 667.332612] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 667.333596] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.333893] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.335013] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.335476] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.335476] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.336782] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.336782] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 667.338163] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.338424] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.339161] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 667.339269] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 667.339500] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 667.339500] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 667.339962] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.344014] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 667.344014] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344014] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344014] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344014] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344266] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344266] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344266] nova-scheduler[51431]: DEBUG nova.filters [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.344266] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 667.344266] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 667.344436] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Attempting to claim resources in the placement API for instance 238825ed-3715-444c-be7c-f42f3884df7c {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 667.382744] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.383263] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.383263] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.390561] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.391279] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.391279] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.393183] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.393386] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.393873] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 667.394166] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 667.394339] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 667.394591] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 667.394769] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.395209] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 667.395265] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.395851] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.396049] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.396232] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.396399] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.396565] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.396728] nova-scheduler[51429]: DEBUG nova.filters [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 667.397050] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 667.397279] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 667.397559] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Attempting to claim resources in the placement API for instance 2342e3da-6d68-466a-9140-ced4eeda73d7 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 667.402865] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] [instance: 238825ed-3715-444c-be7c-f42f3884df7c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 667.402865] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.403624] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.403624] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-53e9ea92-0458-4457-a018-7443031d5b85 tempest-ServerActionsTestOtherA-889365662 tempest-ServerActionsTestOtherA-889365662-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.462260] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] [instance: 2342e3da-6d68-466a-9140-ced4eeda73d7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 667.462260] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.462260] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.462493] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-14cc2716-f2a3-4bc8-91ae-56740912fc57 tempest-SecurityGroupsTestJSON-1449800206 tempest-SecurityGroupsTestJSON-1449800206-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.517770] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Starting to schedule for instances: ['8264a1ad-cf20-404f-9d30-30c126e0c222'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 668.518227] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 668.520788] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.520788] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.520788] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.520788] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 668.574206] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.575076] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.575076] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.583818] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.583818] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.583818] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.586929] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.586929] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.587087] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 668.587169] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 668.587271] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 668.587576] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 668.588446] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.588446] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 668.588446] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.588446] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.588835] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.588835] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.588937] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.589103] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.589270] nova-scheduler[51431]: DEBUG nova.filters [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 668.589424] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 668.590301] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 668.590301] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Attempting to claim resources in the placement API for instance 8264a1ad-cf20-404f-9d30-30c126e0c222 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 668.663813] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] [instance: 8264a1ad-cf20-404f-9d30-30c126e0c222] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 668.665033] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.667139] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.667139] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-cd1bd73c-9e1c-4484-82da-09fd604651d2 tempest-ServerRescueNegativeTestJSON-824119348 tempest-ServerRescueNegativeTestJSON-824119348-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.520984] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Starting to schedule for instances: ['cf939f8d-66e3-4146-8566-2c8d06d6d6da'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 670.521653] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 670.521865] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.523225] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.523225] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 670.523225] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 670.572456] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.572751] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.572882] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.582871] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.582871] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.582871] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.583769] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.583965] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.584359] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 670.584634] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 670.584828] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 670.584994] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 670.585177] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.585429] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 670.585625] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.585807] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.586023] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.586187] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.586386] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.586557] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.586714] nova-scheduler[51429]: DEBUG nova.filters [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 670.586865] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 670.587038] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 670.587210] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Attempting to claim resources in the placement API for instance cf939f8d-66e3-4146-8566-2c8d06d6d6da {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 670.643026] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] [instance: cf939f8d-66e3-4146-8566-2c8d06d6d6da] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 670.643720] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 670.643720] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 670.643720] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.339413] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting to schedule for instances: ['a6ff207e-a925-46d1-9aaf-e06268d3c6f2'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 671.340328] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 671.340508] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.340711] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.341082] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.341909] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 671.389228] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.389228] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.389228] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.398320] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.398320] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.398320] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.400081] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.400676] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.400980] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 671.401351] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 671.401528] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 671.401973] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 671.402223] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.402712] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 671.402973] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.403246] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.403527] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.403686] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.403911] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.404452] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.404452] nova-scheduler[51431]: DEBUG nova.filters [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 671.404452] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 671.404842] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 671.405150] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Attempting to claim resources in the placement API for instance a6ff207e-a925-46d1-9aaf-e06268d3c6f2 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 671.470070] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] [instance: a6ff207e-a925-46d1-9aaf-e06268d3c6f2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 671.470410] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.470618] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.470837] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-75c8ffdd-c2cb-4058-970c-d0dc2a096f28 tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.980105] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Starting to schedule for instances: ['03742e11-0fb2-48e2-9093-77ea7b647bf3'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 671.980382] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 671.980543] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.980723] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.982583] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.982583] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 672.033770] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.036543] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.036750] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.043763] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.043961] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.044131] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.046299] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.046492] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.047076] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 672.047893] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 672.047893] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 672.047893] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 672.048113] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.048168] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 672.048348] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.048531] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.048723] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.048910] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.049062] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.049232] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.049395] nova-scheduler[51429]: DEBUG nova.filters [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.049549] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 672.049718] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 672.049968] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Attempting to claim resources in the placement API for instance 03742e11-0fb2-48e2-9093-77ea7b647bf3 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 672.107961] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] [instance: 03742e11-0fb2-48e2-9093-77ea7b647bf3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 672.108319] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.109587] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.109587] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-68be1b59-24b9-4b71-afba-c46bf9c469a2 tempest-ServerTagsTestJSON-2100948233 tempest-ServerTagsTestJSON-2100948233-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.919871] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Starting to schedule for instances: ['05010bc2-c30a-49bf-8daa-3eec6a5e9022'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 672.919871] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 672.924113] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 672.924113] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 672.924113] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 672.924113] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 672.975144] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.975664] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.975734] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.986454] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.986454] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.986454] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.988742] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 672.988742] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 672.988900] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 672.989294] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 672.989355] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 672.989503] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 672.989668] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 672.989967] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 672.990975] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.990975] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.990975] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.990975] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.990975] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.991185] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.991259] nova-scheduler[51431]: DEBUG nova.filters [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 672.991414] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 672.991688] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 672.991924] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Attempting to claim resources in the placement API for instance 05010bc2-c30a-49bf-8daa-3eec6a5e9022 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 673.064790] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] [instance: 05010bc2-c30a-49bf-8daa-3eec6a5e9022] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 673.065161] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.065413] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.065655] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f266e82b-4618-4f1b-aca0-2ae761f4878b tempest-InstanceActionsNegativeTestJSON-1893694906 tempest-InstanceActionsNegativeTestJSON-1893694906-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.073141] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['5df12084-5dd6-41d1-9743-747f17ce3323'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 674.073141] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 674.073141] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.073141] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.074065] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.074592] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 674.125896] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.125896] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.125896] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.134687] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.135066] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.135385] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.137915] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.138285] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.138867] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 674.141021] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 674.141021] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 674.141021] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 674.141256] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.141256] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 674.141256] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.141256] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.141256] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.141396] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.141615] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.141913] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.142248] nova-scheduler[51429]: DEBUG nova.filters [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 674.142552] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 674.142883] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 674.143197] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Attempting to claim resources in the placement API for instance 5df12084-5dd6-41d1-9743-747f17ce3323 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 674.193743] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] [instance: 5df12084-5dd6-41d1-9743-747f17ce3323] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 674.194043] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.194261] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.194467] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-548c9425-6a50-4d5f-a318-e114e48dce4f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 675.685550] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Starting to schedule for instances: ['2ed6496a-3e75-4cfd-88da-9e0b731f738a'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 675.686187] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 675.687122] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 675.687490] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 675.690158] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 675.690158] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 675.727049] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 675.727305] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 675.727474] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 675.734249] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 675.734494] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 675.734711] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 675.736845] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 675.737101] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 675.737522] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 675.737900] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 675.738123] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 675.738328] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 675.738531] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 675.738821] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 675.739080] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.739305] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.739540] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.739752] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.740029] nova-scheduler[51431]: DEBUG nova.scheduler.filters.affinity_filter [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Group affinity: check if cpu-1 in [] {{(pid=51431) host_passes /opt/stack/nova/nova/scheduler/filters/affinity_filter.py:152}} [ 675.740227] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.740433] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.740634] nova-scheduler[51431]: DEBUG nova.filters [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 675.740843] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 675.741172] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 675.741404] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Attempting to claim resources in the placement API for instance 2ed6496a-3e75-4cfd-88da-9e0b731f738a {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 675.790558] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] [instance: 2ed6496a-3e75-4cfd-88da-9e0b731f738a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 675.790867] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 675.791110] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 675.791317] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1a5f73e9-aea6-4191-a8b4-431765861858 tempest-ServerGroupTestJSON-1237952674 tempest-ServerGroupTestJSON-1237952674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.139761] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['49d76773-e163-440b-aa99-08c379155149'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 676.140116] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 676.140346] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.140507] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.140701] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.140898] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 676.180057] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.180335] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.180511] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.187434] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.187642] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.187835] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.190057] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.190198] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.190553] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 676.190832] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 676.191015] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 676.191182] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 676.191347] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.191593] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 676.191796] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.191982] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.192238] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.192451] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.192572] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.192737] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.192898] nova-scheduler[51429]: DEBUG nova.filters [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 676.193064] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 676.193236] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 676.193415] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Attempting to claim resources in the placement API for instance 49d76773-e163-440b-aa99-08c379155149 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 676.243331] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] [instance: 49d76773-e163-440b-aa99-08c379155149] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 676.243331] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.243506] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.243703] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5988d750-59d3-4b51-8b34-9653780a2324 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.204902] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting to schedule for instances: ['dac8465a-592f-461c-af5b-49369eed5e70'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 681.207874] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 681.207874] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.207874] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.207874] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.207874] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 681.267568] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.267878] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.268107] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.275712] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.275828] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.276017] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.278734] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.278878] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.282536] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 681.283522] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 681.283522] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 681.283666] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 681.284033] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.284424] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 681.284754] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.284897] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.285103] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.286110] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.286110] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.286110] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.286110] nova-scheduler[51431]: DEBUG nova.filters [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.286110] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 681.286321] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 681.286321] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Attempting to claim resources in the placement API for instance dac8465a-592f-461c-af5b-49369eed5e70 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 681.354444] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] [instance: dac8465a-592f-461c-af5b-49369eed5e70] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 681.354828] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.355059] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.355266] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3ac6f48c-ebc2-4bc7-9198-de6d492764ef tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.665996] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Starting to schedule for instances: ['54605814-fdf4-43c7-9316-0d2594cdb5fa'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 681.666309] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 681.666639] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.666702] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.666857] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.668078] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 681.720145] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.720385] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.720563] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.727625] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.727911] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.728100] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.731196] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.731196] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.731369] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 681.731693] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 681.731867] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 681.732068] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 681.732219] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.732468] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 681.732671] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.732856] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.733122] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.733343] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.733517] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.733685] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.733850] nova-scheduler[51429]: DEBUG nova.filters [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 681.734014] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 681.734206] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 681.734381] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Attempting to claim resources in the placement API for instance 54605814-fdf4-43c7-9316-0d2594cdb5fa {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 681.782763] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] [instance: 54605814-fdf4-43c7-9316-0d2594cdb5fa] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 681.783110] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.783339] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.783547] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b4c2d3a9-5cd7-4113-8d35-670bb3ea1350 tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.364120] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Starting to schedule for instances: ['f196648e-0e82-4a01-91fc-af1ba61f0490'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 682.368019] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 682.368019] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.368019] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.368019] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.368252] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 682.405724] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.405943] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.406133] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.413030] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.414987] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.414987] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.415762] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.415964] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.416340] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 682.416675] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 682.416845] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 682.420019] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 682.420019] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.420019] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 682.420019] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420344] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420344] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420344] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420344] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420344] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420488] nova-scheduler[51431]: DEBUG nova.filters [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.420488] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 682.420488] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 682.420488] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Attempting to claim resources in the placement API for instance f196648e-0e82-4a01-91fc-af1ba61f0490 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 682.478129] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] [instance: f196648e-0e82-4a01-91fc-af1ba61f0490] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 682.478129] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.478129] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.478285] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-1f90d099-0f06-4f6c-8f82-3f162df27704 tempest-FloatingIPsAssociationTestJSON-1854484624 tempest-FloatingIPsAssociationTestJSON-1854484624-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.518688] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Starting to schedule for instances: ['66420486-d25e-457d-94cd-6f96fca2df7d'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 682.518688] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 682.518688] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.518688] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.518688] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.518991] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 682.572683] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.573278] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.573278] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.579997] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.580136] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.580280] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.583107] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.583107] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.583207] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 682.583397] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 682.583674] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 682.583835] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 682.583902] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.584144] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 682.584312] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.584541] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.584685] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.584850] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.585081] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.585216] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.585506] nova-scheduler[51429]: DEBUG nova.filters [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 682.585563] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 682.585738] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 682.585868] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Attempting to claim resources in the placement API for instance 66420486-d25e-457d-94cd-6f96fca2df7d {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 682.640758] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] [instance: 66420486-d25e-457d-94cd-6f96fca2df7d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 682.641104] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.641321] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.641524] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-eb8449b9-6d26-4a9d-a599-af26500e764c tempest-ServerShowV257Test-322135073 tempest-ServerShowV257Test-322135073-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.943330] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Starting to schedule for instances: ['a1dd5ca8-4210-4950-8a6e-a7e05b9a38a0'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 682.943870] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 682.944127] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.945779] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.945779] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 682.946012] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 682.988080] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.988803] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.988803] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.995435] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.995637] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.997045] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 682.999452] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 682.999452] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 682.999606] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_spawning='10',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 682.999606] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 682.999715] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 682.999774] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Update host state with instances: ['ccaea0a9-59d6-456a-9885-2b90abf30abb', 'b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 682.999937] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.000207] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 683.000414] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.000598] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.000800] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.000989] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.001179] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.001344] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.001538] nova-scheduler[51431]: DEBUG nova.filters [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 683.001847] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 683.001847] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 683.001983] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Attempting to claim resources in the placement API for instance a1dd5ca8-4210-4950-8a6e-a7e05b9a38a0 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 683.049973] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] [instance: a1dd5ca8-4210-4950-8a6e-a7e05b9a38a0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 683.050507] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.050795] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.050943] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-01085bf9-6130-43fe-8c8e-78467ff0241a tempest-ServerShowV247Test-1223997438 tempest-ServerShowV247Test-1223997438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.444019] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Starting to schedule for instances: ['13aee471-4813-4376-a7bf-70f266d9a399'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 716.444019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 716.444019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.444019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.444316] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.444316] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 716.484172] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.484405] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.484570] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.490797] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.491026] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.491208] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.493377] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.493565] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.493919] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6877b048a8b4486bbbc359726a58f5e6='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='1',num_proj_940667196dca494b839e5099008c23db='0',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:46:47Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 716.494220] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 716.494375] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 716.494534] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', 'd74c7de4-5126-483f-9576-89e0007310b8', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '14e395c0-3650-40d6-82f1-1bd8f0b29984'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 716.494695] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.494941] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 716.495155] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.495341] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.495534] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.495700] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.495885] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.496088] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.496257] nova-scheduler[51429]: DEBUG nova.filters [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.496419] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 716.496582] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 716.496753] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Attempting to claim resources in the placement API for instance 13aee471-4813-4376-a7bf-70f266d9a399 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 716.545214] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] [instance: 13aee471-4813-4376-a7bf-70f266d9a399] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 716.545524] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.545735] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.545942] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.798297] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Starting to schedule for instances: ['69c3c034-7b7e-46fc-90f7-1d76d2db5c0d'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 742.798598] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 742.798760] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.798958] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.799203] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.799395] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 742.839043] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.839283] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.839451] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.847797] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.847797] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.847797] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.850603] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.852058] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.852138] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6877b048a8b4486bbbc359726a58f5e6='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='0',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:47:36Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 742.852233] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 742.852233] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 742.852233] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 742.852376] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.852551] nova-scheduler[51431]: DEBUG nova.filters [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.852768] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:46:22. Elapsed time is 76.701635 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 742.852927] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 742.853094] nova-scheduler[51431]: INFO nova.filters [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Filter ComputeFilter returned 0 hosts [ 742.853248] nova-scheduler[51431]: DEBUG nova.filters [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Filtering removed all hosts for the request with instance ID '69c3c034-7b7e-46fc-90f7-1d76d2db5c0d'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 742.853387] nova-scheduler[51431]: INFO nova.filters [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Filtering removed all hosts for the request with instance ID '69c3c034-7b7e-46fc-90f7-1d76d2db5c0d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 742.853535] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.853678] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-e930889b-76bf-4294-a8c1-138e3e327fd5 tempest-ServersAdminNegativeTestJSON-1657668231 tempest-ServersAdminNegativeTestJSON-1657668231-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 746.691438] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Starting to schedule for instances: ['96dc2c7c-8455-44c7-8a7d-5d6d7903fdb2'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 746.691732] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 746.691886] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.692472] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.692736] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.697043] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 746.741525] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.741755] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.741923] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.748755] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.748859] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.749022] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.751738] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.751945] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.752324] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='4',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6877b048a8b4486bbbc359726a58f5e6='0',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='0',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b2f7e4ed23c24eaf9e9b0300e9b8b2bf='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:47:39Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 746.752606] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 746.752775] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 746.752934] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 746.753116] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.753420] nova-scheduler[51429]: DEBUG nova.filters [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 746.753568] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:46:22. Elapsed time is 80.602442 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 746.753722] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 746.753876] nova-scheduler[51429]: INFO nova.filters [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filter ComputeFilter returned 0 hosts [ 746.754040] nova-scheduler[51429]: DEBUG nova.filters [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filtering removed all hosts for the request with instance ID '96dc2c7c-8455-44c7-8a7d-5d6d7903fdb2'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 746.754191] nova-scheduler[51429]: INFO nova.filters [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filtering removed all hosts for the request with instance ID '96dc2c7c-8455-44c7-8a7d-5d6d7903fdb2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 746.754325] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 746.754471] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-e59bbb2e-8f2d-4c3a-b364-c252d07b11fe tempest-MigrationsAdminTest-1277263470 tempest-MigrationsAdminTest-1277263470-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 751.510242] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Starting to schedule for instances: ['2dd6864b-6980-4e92-9a3c-cfa94185f162'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 751.510489] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 751.510797] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.511114] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.511434] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.511744] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 751.559952] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.559952] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.559952] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.572315] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.572315] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.572315] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.574180] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.574425] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.574839] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='4',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6877b048a8b4486bbbc359726a58f5e6='0',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='0',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b2f7e4ed23c24eaf9e9b0300e9b8b2bf='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:47:39Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 751.575188] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 751.575411] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 751.575616] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 751.575808] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.576120] nova-scheduler[51431]: DEBUG nova.filters [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 751.576334] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:46:22. Elapsed time is 85.425209 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 751.576484] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 751.576636] nova-scheduler[51431]: INFO nova.filters [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filter ComputeFilter returned 0 hosts [ 751.576782] nova-scheduler[51431]: DEBUG nova.filters [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filtering removed all hosts for the request with instance ID '2dd6864b-6980-4e92-9a3c-cfa94185f162'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 751.576914] nova-scheduler[51431]: INFO nova.filters [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filtering removed all hosts for the request with instance ID '2dd6864b-6980-4e92-9a3c-cfa94185f162'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 751.577066] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 751.577210] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-355812aa-810a-4df8-98c5-0d85a0afde9c tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 755.931884] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Starting to schedule for instances: ['5cb86085-958f-428a-95a5-2471b6576043'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 755.931884] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 755.932131] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.932940] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.932940] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 755.932940] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 755.980949] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.981204] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.981374] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.988220] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.988220] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.988220] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.990864] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.990864] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.991138] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='4',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_51248048a2ed4ee1801cec899ba5301b='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6877b048a8b4486bbbc359726a58f5e6='0',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_9257ab9cebe8414fbc0c992b8c344182='0',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b2f7e4ed23c24eaf9e9b0300e9b8b2bf='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='2',num_task_spawning='8',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:47:39Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 755.991416] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 755.991612] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 46, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 755.991732] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 755.991890] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.992158] nova-scheduler[51429]: DEBUG nova.filters [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 755.992381] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:46:22. Elapsed time is 89.841249 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 755.992867] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 755.992867] nova-scheduler[51429]: INFO nova.filters [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filter ComputeFilter returned 0 hosts [ 755.992867] nova-scheduler[51429]: DEBUG nova.filters [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filtering removed all hosts for the request with instance ID '5cb86085-958f-428a-95a5-2471b6576043'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 755.993036] nova-scheduler[51429]: INFO nova.filters [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filtering removed all hosts for the request with instance ID '5cb86085-958f-428a-95a5-2471b6576043'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 755.993114] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 755.993263] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f4c8ed8b-41d9-4d1c-b4eb-534824188c4d tempest-ServersTestMultiNic-1512351721 tempest-ServersTestMultiNic-1512351721-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 780.451876] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.452113] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.452243] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.452243] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.452306] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.452340] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.452463] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.452664] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.452890] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.453076] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.456971] nova-scheduler[51429]: INFO nova.scheduler.host_manager [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 780.457046] nova-scheduler[51431]: INFO nova.scheduler.host_manager [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 780.457189] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.457242] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-b54c95b7-75d9-48a1-bc68-3469cb5bb54b None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.303859] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Starting to schedule for instances: ['06d5ac6a-7734-46e3-80c5-d960821b7552'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 792.304195] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 792.304355] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.304570] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.308320] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.308546] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 792.357464] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.357614] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.357812] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.364408] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.364616] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.364785] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.366919] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.367132] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.367500] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='1',num_proj_51248048a2ed4ee1801cec899ba5301b='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b2f7e4ed23c24eaf9e9b0300e9b8b2bf='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:48:25Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 792.367807] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 792.368033] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 792.368208] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Update host state with instances: ['50ff2169-9c1f-4f7a-b365-1949dac57f86', '294a5f91-9db2-4a43-8230-d3e6906c30f0', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7', '8264a1ad-cf20-404f-9d30-30c126e0c222'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 792.368428] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.368612] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 792.368816] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.369047] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.369259] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.369425] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.369586] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.369747] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.369938] nova-scheduler[51431]: DEBUG nova.filters [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 792.370114] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 792.370282] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 792.370452] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Attempting to claim resources in the placement API for instance 06d5ac6a-7734-46e3-80c5-d960821b7552 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 792.418347] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] [instance: 06d5ac6a-7734-46e3-80c5-d960821b7552] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 792.418658] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.418864] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.419081] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5f170e36-7309-4b78-83bf-80c26bf2baf2 tempest-ServerActionsTestOtherB-1224251085 tempest-ServerActionsTestOtherB-1224251085-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.528918] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.update_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.529793] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.update_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.529793] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.update_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.529793] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.update_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.530163] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.update_instance_info" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.530163] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-3182a4c8-021b-42d4-9a45-4c6ff298719e tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.update_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.811961] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-a1eb2a74-de4b-4a76-81b5-4064150a190b tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.812242] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a1eb2a74-de4b-4a76-81b5-4064150a190b tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.812419] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-a1eb2a74-de4b-4a76-81b5-4064150a190b tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.812454] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a1eb2a74-de4b-4a76-81b5-4064150a190b tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.812454] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-a1eb2a74-de4b-4a76-81b5-4064150a190b tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.812521] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-a1eb2a74-de4b-4a76-81b5-4064150a190b tempest-ServerActionsV293TestJSON-1353407144 tempest-ServerActionsV293TestJSON-1353407144-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 836.804248] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ea092af5-458f-4bc6-b710-670549537c7b tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 836.804248] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ea092af5-458f-4bc6-b710-670549537c7b tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 836.804854] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-ea092af5-458f-4bc6-b710-670549537c7b tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 836.805092] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ea092af5-458f-4bc6-b710-670549537c7b tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 836.805160] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-ea092af5-458f-4bc6-b710-670549537c7b tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 836.805160] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-ea092af5-458f-4bc6-b710-670549537c7b tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 837.105019] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Starting to schedule for instances: ['64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 837.105019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 837.105019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 837.105019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 837.105019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 837.105332] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 837.147368] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 837.147552] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 837.147719] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 837.154294] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 837.154516] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 837.154881] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='1',num_proj_51248048a2ed4ee1801cec899ba5301b='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_6d2413e255144034ba23edb5eac6962a='0',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b2f7e4ed23c24eaf9e9b0300e9b8b2bf='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='0',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='3',num_task_spawning='7',num_vm_building='10',num_vm_error='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:12Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 837.155192] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 837.155362] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 837.155534] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 837.155701] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 837.155948] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 837.156213] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.156351] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.158020] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.158020] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.158020] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.158020] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.158020] nova-scheduler[51429]: DEBUG nova.filters [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 837.158262] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 837.158262] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 837.158262] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Attempting to claim resources in the placement API for instance 64bc3ac9-57b4-4f50-97fa-ba684c1595b4 {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 837.200638] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] [instance: 64bc3ac9-57b4-4f50-97fa-ba684c1595b4] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 837.200936] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 837.201153] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 837.201361] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9b15c83c-0519-41c7-9ec6-84bb45a65a53 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 870.125775] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting to schedule for instances: ['057d3204-a94c-40e3-b339-c5d2ff9ff0a1'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 870.126306] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 870.126378] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 870.126538] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 870.127142] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 870.127337] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 870.174901] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 870.175147] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 870.175313] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 870.185777] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 870.185888] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 870.186247] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 870.186562] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 870.186735] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 870.186893] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 870.187069] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 870.187771] nova-scheduler[51431]: DEBUG nova.filters [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 870.187771] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 84.036408 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 870.187771] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 870.188472] nova-scheduler[51431]: INFO nova.filters [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filter ComputeFilter returned 0 hosts [ 870.188472] nova-scheduler[51431]: DEBUG nova.filters [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtering removed all hosts for the request with instance ID '057d3204-a94c-40e3-b339-c5d2ff9ff0a1'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 870.188472] nova-scheduler[51431]: INFO nova.filters [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtering removed all hosts for the request with instance ID '057d3204-a94c-40e3-b339-c5d2ff9ff0a1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 870.188472] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 870.188661] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2a69071b-0bc3-4235-a9d4-2b9762609ccd tempest-ImagesTestJSON-677661905 tempest-ImagesTestJSON-677661905-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 871.886996] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Starting to schedule for instances: ['0bf69a57-7106-4ed7-a11b-cd47a68ae87a'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 871.889251] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 871.889474] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 871.889689] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 871.889930] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 871.890166] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 871.945493] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 871.945493] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 871.945677] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 871.952844] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 871.953064] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 871.953420] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 871.953681] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 871.953887] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 871.953998] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 871.954213] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 871.954413] nova-scheduler[51429]: DEBUG nova.filters [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 871.954617] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 85.8035 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 871.954794] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 871.954908] nova-scheduler[51429]: INFO nova.filters [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Filter ComputeFilter returned 0 hosts [ 871.955186] nova-scheduler[51429]: DEBUG nova.filters [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Filtering removed all hosts for the request with instance ID '0bf69a57-7106-4ed7-a11b-cd47a68ae87a'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 871.955186] nova-scheduler[51429]: INFO nova.filters [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Filtering removed all hosts for the request with instance ID '0bf69a57-7106-4ed7-a11b-cd47a68ae87a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 871.955398] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 871.955490] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-23815266-8ae5-4908-a48b-5a4835689e9c tempest-ServersNegativeTestJSON-1931441335 tempest-ServersNegativeTestJSON-1931441335-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 874.869256] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['3f72d1f3-b87e-485c-83dd-bf702f3fb283'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 874.869507] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 874.869560] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 874.869726] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 874.869937] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 874.870170] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 874.911687] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 874.912053] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 874.912333] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 874.920284] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 874.920492] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 874.923537] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 874.923800] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 874.923800] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 874.923800] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 874.923948] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 874.923948] nova-scheduler[51431]: DEBUG nova.filters [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 874.923948] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 88.77095 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 874.923948] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 874.923948] nova-scheduler[51431]: INFO nova.filters [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 0 hosts [ 874.924118] nova-scheduler[51431]: DEBUG nova.filters [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '3f72d1f3-b87e-485c-83dd-bf702f3fb283'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 874.924118] nova-scheduler[51431]: INFO nova.filters [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '3f72d1f3-b87e-485c-83dd-bf702f3fb283'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 874.924118] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 874.924118] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-ac775eca-668f-47b5-b70f-e0649c59b0c9 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 875.065137] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['ab676438-ff9f-4cb7-8727-9153b124f967'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 875.065437] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 875.065593] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 875.065766] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 875.065952] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 875.066141] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 875.106650] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.107268] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.107451] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.114279] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 875.114538] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 875.114905] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 875.115234] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 875.115489] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 875.115671] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 875.115835] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 875.116098] nova-scheduler[51429]: DEBUG nova.filters [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 875.116307] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 88.965184 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 875.116459] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 875.116608] nova-scheduler[51429]: INFO nova.filters [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 0 hosts [ 875.116751] nova-scheduler[51429]: DEBUG nova.filters [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID 'ab676438-ff9f-4cb7-8727-9153b124f967'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 875.116886] nova-scheduler[51429]: INFO nova.filters [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID 'ab676438-ff9f-4cb7-8727-9153b124f967'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 875.117041] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 875.117199] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-f576727a-3907-4296-a638-fd043e41f513 tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 876.570286] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['ecdc3209-5525-46f5-a7ba-30b0bcb3b6c3'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 876.570570] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 876.570867] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 876.570977] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 876.576499] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 876.576499] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 876.646301] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 876.646301] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 876.646301] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 876.654605] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 876.654912] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 876.655248] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 876.655841] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 876.656015] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 876.656174] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 876.657101] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 876.657101] nova-scheduler[51431]: DEBUG nova.filters [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 876.657101] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 90.505672 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 876.657101] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 876.657101] nova-scheduler[51431]: INFO nova.filters [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 0 hosts [ 876.658509] nova-scheduler[51431]: DEBUG nova.filters [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID 'ecdc3209-5525-46f5-a7ba-30b0bcb3b6c3'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 876.658509] nova-scheduler[51431]: INFO nova.filters [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID 'ecdc3209-5525-46f5-a7ba-30b0bcb3b6c3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 876.658509] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 876.658509] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-c56e569f-ca40-4057-8128-36443618548f tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 877.900052] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting to schedule for instances: ['06b19d37-a077-4239-94b6-34faf90399fe'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 877.900052] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 877.900052] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 877.900052] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 877.900052] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 877.900982] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 877.956272] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 877.956873] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 877.956873] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 877.964666] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 877.964666] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 877.964770] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 877.966397] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 877.966397] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 877.966397] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 877.966587] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 877.966587] nova-scheduler[51429]: DEBUG nova.filters [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 877.966693] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 91.815549 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 877.966918] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 877.966980] nova-scheduler[51429]: INFO nova.filters [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filter ComputeFilter returned 0 hosts [ 877.967141] nova-scheduler[51429]: DEBUG nova.filters [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '06b19d37-a077-4239-94b6-34faf90399fe'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 877.967272] nova-scheduler[51429]: INFO nova.filters [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtering removed all hosts for the request with instance ID '06b19d37-a077-4239-94b6-34faf90399fe'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 877.967410] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 877.967562] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-1df1330e-c5b7-4891-857d-0c50eb75a02f tempest-DeleteServersTestJSON-1450295516 tempest-DeleteServersTestJSON-1450295516-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 879.840439] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting to schedule for instances: ['57be078d-9dae-4a47-8d4c-875d8650089e'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 879.840735] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 879.841314] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 879.841542] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 879.841758] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 879.841961] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 879.889053] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 879.889332] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 879.890066] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.898412] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 879.898412] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 879.898575] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 879.898652] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 879.898769] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 879.898885] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 879.899063] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.899322] nova-scheduler[51431]: DEBUG nova.filters [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 879.899526] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 93.748406 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 879.899895] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 879.899895] nova-scheduler[51431]: INFO nova.filters [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ComputeFilter returned 0 hosts [ 879.900023] nova-scheduler[51431]: DEBUG nova.filters [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID '57be078d-9dae-4a47-8d4c-875d8650089e'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 879.900166] nova-scheduler[51431]: INFO nova.filters [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID '57be078d-9dae-4a47-8d4c-875d8650089e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 879.900311] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 879.900457] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-0a75bf5d-2dd5-49f4-bcc1-0c0a3a51d4f0 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 880.961672] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['619d69b4-4fd5-4d17-b3fe-50dc655150d0'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 880.962564] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 880.962770] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 880.962964] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 880.963183] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 880.963360] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 881.008681] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.009533] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.009747] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.019782] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.020040] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.020420] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 881.020693] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 881.020861] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 881.021060] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 881.021244] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.021503] nova-scheduler[51429]: DEBUG nova.filters [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 881.021711] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 94.870585 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 881.021866] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 881.022131] nova-scheduler[51429]: INFO nova.filters [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 0 hosts [ 881.022310] nova-scheduler[51429]: DEBUG nova.filters [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '619d69b4-4fd5-4d17-b3fe-50dc655150d0'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 881.022451] nova-scheduler[51429]: INFO nova.filters [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '619d69b4-4fd5-4d17-b3fe-50dc655150d0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 881.022597] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 881.022747] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-7ec58ff8-4990-431e-85b7-7ec11d5567fd tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 881.059233] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Starting to schedule for instances: ['5a28964c-26cb-43ef-8192-39d088e92fc2'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 881.059546] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 881.059710] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 881.059904] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 881.060983] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 881.061241] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 881.111206] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.111955] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.112243] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.122583] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 881.122937] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 881.123464] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 881.123772] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 881.124155] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 881.124374] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 881.124639] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 881.124875] nova-scheduler[51431]: DEBUG nova.filters [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 881.125104] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 94.973965 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 881.125260] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 881.125411] nova-scheduler[51431]: INFO nova.filters [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Filter ComputeFilter returned 0 hosts [ 881.125557] nova-scheduler[51431]: DEBUG nova.filters [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Filtering removed all hosts for the request with instance ID '5a28964c-26cb-43ef-8192-39d088e92fc2'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 881.125826] nova-scheduler[51431]: INFO nova.filters [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Filtering removed all hosts for the request with instance ID '5a28964c-26cb-43ef-8192-39d088e92fc2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 881.126024] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 881.126180] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e65b975-6224-4a7f-99b6-95ff3a88be2a tempest-ServerMetadataTestJSON-1850876667 tempest-ServerMetadataTestJSON-1850876667-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 882.956298] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting to schedule for instances: ['e5438fb2-ab9d-4822-8d89-977264007e0f'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 882.956584] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 882.956747] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 882.957018] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 882.957267] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 882.957463] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 883.064121] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 883.064347] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 883.064511] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 883.073325] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 883.073431] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 883.073832] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='6',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:49:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 883.074129] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 883.074342] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 883.074550] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 883.075086] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 883.075086] nova-scheduler[51429]: DEBUG nova.filters [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 883.075389] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 96.924146 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 883.075523] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 883.075737] nova-scheduler[51429]: INFO nova.filters [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ComputeFilter returned 0 hosts [ 883.076025] nova-scheduler[51429]: DEBUG nova.filters [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID 'e5438fb2-ab9d-4822-8d89-977264007e0f'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 883.077244] nova-scheduler[51429]: INFO nova.filters [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID 'e5438fb2-ab9d-4822-8d89-977264007e0f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 883.077786] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 883.078326] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-5c656e20-2806-41bc-bed1-a27b32a6263f tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 884.151662] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['5382cfb7-f75c-4310-905f-ad7b71738afe'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 884.151983] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 884.153888] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 884.154102] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 884.154309] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 884.154492] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 884.207515] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.207828] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.208014] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.214648] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 884.214959] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 884.215902] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='2',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='5',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:00Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=9) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 884.216039] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 884.216039] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 884.216039] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '19253198-cb6e-4c48-a88b-26780f3606e8', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 884.216296] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 884.216296] nova-scheduler[51431]: DEBUG nova.filters [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 884.216852] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 98.065292 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 884.216852] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 has not been heard from in a while [ 884.216852] nova-scheduler[51431]: INFO nova.filters [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 0 hosts [ 884.217100] nova-scheduler[51431]: DEBUG nova.filters [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '5382cfb7-f75c-4310-905f-ad7b71738afe'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 884.217100] nova-scheduler[51431]: INFO nova.filters [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '5382cfb7-f75c-4310-905f-ad7b71738afe'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 884.217309] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 884.217543] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5027840d-2b0e-48e8-8d91-d627851a9bd4 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 885.233953] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7a018914-2a3f-4174-be84-1fe6925178cc tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 885.234237] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7a018914-2a3f-4174-be84-1fe6925178cc tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 885.234282] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7a018914-2a3f-4174-be84-1fe6925178cc tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 885.235027] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-7a018914-2a3f-4174-be84-1fe6925178cc tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 885.235131] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7a018914-2a3f-4174-be84-1fe6925178cc tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 885.235131] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7a018914-2a3f-4174-be84-1fe6925178cc tempest-ServerExternalEventsTest-827682188 tempest-ServerExternalEventsTest-827682188-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 885.529750] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting to schedule for instances: ['d149565e-1a7e-4598-b771-e9cb65dc3004'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 885.530104] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 885.530553] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 885.530553] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 885.530701] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 885.530832] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 885.590607] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 885.590841] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 885.591041] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 885.597421] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 885.597664] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 885.598118] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='2',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='1',num_task_deleting='5',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:00Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=9) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 885.598448] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 885.598651] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 885.598844] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 885.599052] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 885.599360] nova-scheduler[51429]: DEBUG nova.filters [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 885.599605] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 99.448466 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 885.599792] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 has not been heard from in a while [ 885.600017] nova-scheduler[51429]: INFO nova.filters [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ComputeFilter returned 0 hosts [ 885.600208] nova-scheduler[51429]: DEBUG nova.filters [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID 'd149565e-1a7e-4598-b771-e9cb65dc3004'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 885.600394] nova-scheduler[51429]: INFO nova.filters [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID 'd149565e-1a7e-4598-b771-e9cb65dc3004'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 885.600576] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 885.600793] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-9bfa8f23-0542-4fc5-b924-fde2e4934263 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 886.329185] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['94c33d75-7797-40f7-8dad-02d6e9a6bc1e'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 886.329185] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 886.329185] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 886.329185] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 886.329185] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 886.329830] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 886.385452] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 886.385715] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 886.386265] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 886.400447] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 886.400695] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 886.401169] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='11',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='2',num_task_deleting='5',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:01Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 886.401380] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 886.401546] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 886.401701] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 886.401863] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 886.404234] nova-scheduler[51431]: DEBUG nova.filters [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 886.404471] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 100.253316 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 886.404648] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 195584MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 886.404805] nova-scheduler[51431]: INFO nova.filters [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 0 hosts [ 886.404954] nova-scheduler[51431]: DEBUG nova.filters [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '94c33d75-7797-40f7-8dad-02d6e9a6bc1e'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 886.405110] nova-scheduler[51431]: INFO nova.filters [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '94c33d75-7797-40f7-8dad-02d6e9a6bc1e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 886.405257] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 886.405862] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-7362637c-7d71-4e22-8b2c-50fa34785c48 tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 887.469984] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting to schedule for instances: ['56022297-6c1c-4dc5-bf0c-062a93fe7331'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 887.470334] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 887.470513] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 887.470696] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 887.470919] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 887.471158] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 887.512905] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 887.513199] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 887.513378] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 887.520257] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 887.520510] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 887.520897] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='11',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='2',num_task_deleting='5',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:01Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 887.521206] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 887.521377] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 887.521535] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 887.521698] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 887.521942] nova-scheduler[51429]: DEBUG nova.filters [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 887.522171] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 101.37103 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 887.522338] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 195584MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 887.522501] nova-scheduler[51429]: INFO nova.filters [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filter ComputeFilter returned 0 hosts [ 887.522647] nova-scheduler[51429]: DEBUG nova.filters [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID '56022297-6c1c-4dc5-bf0c-062a93fe7331'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 887.522783] nova-scheduler[51429]: INFO nova.filters [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtering removed all hosts for the request with instance ID '56022297-6c1c-4dc5-bf0c-062a93fe7331'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 887.522926] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 887.523087] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-0634f099-8d5e-441e-a69a-210679a185d5 tempest-ServerDiskConfigTestJSON-1795533670 tempest-ServerDiskConfigTestJSON-1795533670-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 888.838896] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting to schedule for instances: ['194814ac-60d1-4f7e-abd3-a1c8dc5843fd'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 888.839214] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 888.839371] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 888.839548] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 888.839826] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 888.840453] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 888.886377] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 888.886377] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 888.886377] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 888.891980] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 888.892119] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 888.892414] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='11',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='2',num_task_deleting='5',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:01Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 888.892837] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 888.892837] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 888.892993] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 888.893166] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 888.893420] nova-scheduler[51431]: DEBUG nova.filters [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 888.893626] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 102.7425 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 888.893776] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 195584MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 888.893927] nova-scheduler[51431]: INFO nova.filters [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filter ComputeFilter returned 0 hosts [ 888.894081] nova-scheduler[51431]: DEBUG nova.filters [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '194814ac-60d1-4f7e-abd3-a1c8dc5843fd'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 888.894217] nova-scheduler[51431]: INFO nova.filters [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtering removed all hosts for the request with instance ID '194814ac-60d1-4f7e-abd3-a1c8dc5843fd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 888.894360] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 888.894503] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-16b448cb-b681-4707-b551-e6d82c2b9eaa tempest-ServersTestJSON-1871376988 tempest-ServersTestJSON-1871376988-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 891.795127] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Starting to schedule for instances: ['947e0174-fba0-496a-b314-217a49464527'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 891.795127] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 891.795127] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 891.795127] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 891.795816] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 891.796201] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 891.845258] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 891.845672] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 891.845969] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 891.853655] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 891.854692] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 891.855277] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='11',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='2',num_task_deleting='5',num_task_spawning='3',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:01Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=10) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 891.855733] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 891.856038] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 891.856355] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 891.858019] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 891.858019] nova-scheduler[51429]: DEBUG nova.filters [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 891.858019] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 105.706161 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 891.858019] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 195584MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 891.858019] nova-scheduler[51429]: INFO nova.filters [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Filter ComputeFilter returned 0 hosts [ 891.858291] nova-scheduler[51429]: DEBUG nova.filters [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Filtering removed all hosts for the request with instance ID '947e0174-fba0-496a-b314-217a49464527'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 891.858291] nova-scheduler[51429]: INFO nova.filters [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Filtering removed all hosts for the request with instance ID '947e0174-fba0-496a-b314-217a49464527'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 891.858291] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 891.858707] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-99a25cff-91af-4924-ba85-eb5648a0307d tempest-ServersTestJSON-394239745 tempest-ServersTestJSON-394239745-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 895.525911] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.update_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 895.525911] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.update_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 895.527932] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.update_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 895.528238] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.update_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 895.528404] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.update_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 895.531685] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-e35a761d-52ae-4903-adda-5b41a0cf70b8 tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.update_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 896.762647] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Starting to schedule for instances: ['229f87c6-59f3-4844-acf9-0e2d86a09e7c', '01d6cc22-a864-4096-9799-770464b00baf'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 896.762647] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 896.762647] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 896.762647] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 896.762647] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 896.764908] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 896.816018] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 896.816018] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 896.816176] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 896.822375] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 896.822575] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 896.822935] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=8,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194670,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1920,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=11,service_id=None,stats={failed_builds='0',io_workload='11',num_instances='11',num_os_type_None='11',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='3',num_task_deleting='5',num_task_spawning='3',num_vm_building='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:11Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=11) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 896.824019] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 896.824019] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 896.824019] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7', '13aee471-4813-4376-a7bf-70f266d9a399'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 896.824235] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 896.824235] nova-scheduler[51431]: DEBUG nova.filters [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 896.824235] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 110.673005 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 896.824369] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194670MB disk: 194560MB io_ops: 11 instances: 11, allocation_candidates: 1 has not been heard from in a while [ 896.824418] nova-scheduler[51431]: INFO nova.filters [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filter ComputeFilter returned 0 hosts [ 896.824556] nova-scheduler[51431]: DEBUG nova.filters [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filtering removed all hosts for the request with instance ID '229f87c6-59f3-4844-acf9-0e2d86a09e7c'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 896.824682] nova-scheduler[51431]: INFO nova.filters [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filtering removed all hosts for the request with instance ID '229f87c6-59f3-4844-acf9-0e2d86a09e7c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 896.824817] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 896.824949] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-5d235344-205a-47ec-8152-3594f4a983a9 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 899.622105] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Starting to schedule for instances: ['13266282-b6e8-4de0-87c4-df45db115cff', '7a87fc7f-b725-4eb9-98d6-6e3b1688a6be', '98c527da-012c-4d9c-a9db-b75fec5b426a'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 899.622105] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 899.622506] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 899.622889] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 899.623217] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 899.623590] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 899.673749] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 899.673749] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 899.673933] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 899.683511] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 899.683511] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 899.683817] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194670,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1920,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=11,service_id=None,stats={failed_builds='1',io_workload='11',num_instances='11',num_os_type_None='11',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='0',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='4',num_task_deleting='5',num_task_spawning='2',num_vm_building='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=11) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 899.684170] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 899.684354] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 899.684566] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7', '13aee471-4813-4376-a7bf-70f266d9a399'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 899.684743] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 899.684996] nova-scheduler[51429]: DEBUG nova.filters [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 899.685221] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 113.534091 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 899.685376] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194670MB disk: 194560MB io_ops: 11 instances: 11, allocation_candidates: 1 has not been heard from in a while [ 899.685527] nova-scheduler[51429]: INFO nova.filters [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Filter ComputeFilter returned 0 hosts [ 899.685672] nova-scheduler[51429]: DEBUG nova.filters [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Filtering removed all hosts for the request with instance ID '13266282-b6e8-4de0-87c4-df45db115cff'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 899.685808] nova-scheduler[51429]: INFO nova.filters [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Filtering removed all hosts for the request with instance ID '13266282-b6e8-4de0-87c4-df45db115cff'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 899.685952] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 899.686116] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-fb60e5eb-3cc1-46b0-ac5e-cb93d08eb6d8 tempest-ListServersNegativeTestJSON-891921015 tempest-ListServersNegativeTestJSON-891921015-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 901.045868] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Starting to schedule for instances: ['20b985de-cc32-41ea-b090-385251708ce5', 'ba0f9256-5117-4e3c-9aca-7d2457d8f064'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 901.046213] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 901.046373] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 901.046550] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 901.046742] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 901.046920] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 901.087473] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 901.087695] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 901.087908] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 901.094381] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 901.094630] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 901.094951] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194670,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1920,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=11,service_id=None,stats={failed_builds='1',io_workload='11',num_instances='11',num_os_type_None='11',num_proj_0d64b8a4deb3494ab94a07334278cf23='1',num_proj_171afaa5f3e84fce99d714d965673aab='1',num_proj_188cc585bbcd41899980076b5c302bd1='0',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b1e8436dbc5d4f26b38c83626def8b09='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cba7f3dcabc846a1b0b233e2a84f1a9a='0',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_proj_e3b401b63a9c430c97a0d087a98fe664='1',num_task_None='4',num_task_deleting='5',num_task_spawning='2',num_vm_building='11'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:14Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=11) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 901.095242] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 901.095421] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 48, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 901.095563] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Update host state with instances: ['b9ffb5d9-8d56-4980-9e78-1e003cd56f7e', '50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '238825ed-3715-444c-be7c-f42f3884df7c', '2342e3da-6d68-466a-9140-ced4eeda73d7', '13aee471-4813-4376-a7bf-70f266d9a399'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 901.095720] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 901.095964] nova-scheduler[51431]: DEBUG nova.filters [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 901.096186] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:48:22. Elapsed time is 114.945059 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 901.096470] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194670MB disk: 194560MB io_ops: 11 instances: 11, allocation_candidates: 1 has not been heard from in a while [ 901.096470] nova-scheduler[51431]: INFO nova.filters [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filter ComputeFilter returned 0 hosts [ 901.096620] nova-scheduler[51431]: DEBUG nova.filters [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filtering removed all hosts for the request with instance ID '20b985de-cc32-41ea-b090-385251708ce5'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 901.096755] nova-scheduler[51431]: INFO nova.filters [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filtering removed all hosts for the request with instance ID '20b985de-cc32-41ea-b090-385251708ce5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 901.096892] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 901.097073] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-65480d0b-566c-4b72-af99-f13237b9db86 tempest-MultipleCreateTestJSON-1627576137 tempest-MultipleCreateTestJSON-1627576137-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 901.449508] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 901.449767] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 901.449801] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 901.449826] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 901.449869] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 901.449904] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 901.449904] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 901.449955] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 901.449986] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 901.450127] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 901.452475] nova-scheduler[51429]: INFO nova.scheduler.host_manager [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 901.452707] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 901.453468] nova-scheduler[51431]: INFO nova.scheduler.host_manager [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 901.453666] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9bf63302-a543-4631-a399-4c1689d0ded5 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 908.454525] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Starting to schedule for instances: ['2e622c9d-369c-4c36-a477-3237bea4cf7c'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 908.454858] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 908.458060] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 908.458319] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 908.458544] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 908.458734] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 908.513781] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 908.514014] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 908.514194] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 908.520726] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 908.521026] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 908.521146] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 908.523460] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 908.523664] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 908.524305] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='1',io_workload='7',num_instances='8',num_os_type_None='8',num_proj_396b40d8809545dc8eeb0fc355cfcc58='1',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_deleting='5',num_task_spawning='2',num_vm_active='1',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:19Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=8) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 908.524305] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 908.524480] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 908.524639] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Update host state with instances: ['50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '91dfb2c2-4cec-40ef-a6cf-ccb65fedaefd', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '13aee471-4813-4376-a7bf-70f266d9a399', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 908.524798] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 908.525068] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 908.525277] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.525453] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.525645] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.525805] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.525963] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.526163] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.526333] nova-scheduler[51429]: DEBUG nova.filters [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 908.526488] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 7 instances: 8, allocation_candidates: 1] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 908.526654] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 7 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 908.526825] nova-scheduler[51429]: DEBUG nova.scheduler.utils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Attempting to claim resources in the placement API for instance 2e622c9d-369c-4c36-a477-3237bea4cf7c {{(pid=51429) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 908.579658] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] [instance: 2e622c9d-369c-4c36-a477-3237bea4cf7c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 7 instances: 8, allocation_candidates: 1 {{(pid=51429) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 908.580043] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 908.580282] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 908.580500] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-768b9f98-0bb2-48e7-a254-2f2ed5cacaeb tempest-ServerActionsTestJSON-1462263913 tempest-ServerActionsTestJSON-1462263913-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 917.734022] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d030dd6b-a9e3-4daa-9856-6012c6d3ba5e tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 917.734276] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d030dd6b-a9e3-4daa-9856-6012c6d3ba5e tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 917.734399] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d030dd6b-a9e3-4daa-9856-6012c6d3ba5e tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 917.734428] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d030dd6b-a9e3-4daa-9856-6012c6d3ba5e tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 917.734466] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d030dd6b-a9e3-4daa-9856-6012c6d3ba5e tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 917.734493] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d030dd6b-a9e3-4daa-9856-6012c6d3ba5e tempest-ServersTestBootFromVolume-1547622611 tempest-ServersTestBootFromVolume-1547622611-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 931.608939] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-10bb9d9e-43e6-4b36-8c23-46a06dcf5aa2 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 931.609240] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-10bb9d9e-43e6-4b36-8c23-46a06dcf5aa2 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 931.609372] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-10bb9d9e-43e6-4b36-8c23-46a06dcf5aa2 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 931.609408] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-10bb9d9e-43e6-4b36-8c23-46a06dcf5aa2 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 931.609441] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-10bb9d9e-43e6-4b36-8c23-46a06dcf5aa2 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 931.609477] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-10bb9d9e-43e6-4b36-8c23-46a06dcf5aa2 tempest-FloatingIPsAssociationNegativeTestJSON-180034896 tempest-FloatingIPsAssociationNegativeTestJSON-180034896-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 938.403696] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Starting to schedule for instances: ['9745bc90-6927-46a9-af48-df69046dc2a2'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 938.403982] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 938.404509] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 938.404703] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 938.404913] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 938.405474] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 938.449926] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 938.449926] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 938.449926] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 938.455548] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 938.455899] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 938.456415] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='2',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_396b40d8809545dc8eeb0fc355cfcc58='0',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_a62f6b4b95a847bc914323ae8eca38fc='0',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='1',num_task_None='1',num_task_deleting='4',num_task_spawning='2',num_vm_active='0',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:50:47Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 938.456857] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 938.457157] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 938.457454] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Update host state with instances: ['50ff2169-9c1f-4f7a-b365-1949dac57f86', '2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 938.457742] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 938.458134] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 938.458453] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.458762] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.459075] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.459349] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.459621] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.459886] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.460173] nova-scheduler[51431]: DEBUG nova.filters [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 938.460434] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 938.462019] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 938.462019] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Attempting to claim resources in the placement API for instance 9745bc90-6927-46a9-af48-df69046dc2a2 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 938.516444] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] [instance: 9745bc90-6927-46a9-af48-df69046dc2a2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 938.516444] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 938.516444] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 938.516621] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-9e8f10d9-f5cc-43e3-a33e-fb17a0ba8a4a tempest-ImagesOneServerTestJSON-224376027 tempest-ImagesOneServerTestJSON-224376027-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 978.268811] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4319ac7a-c6b0-401d-8699-fbde4ef96c01 tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 978.269074] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-4319ac7a-c6b0-401d-8699-fbde4ef96c01 tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 978.269206] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4319ac7a-c6b0-401d-8699-fbde4ef96c01 tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 978.269206] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-4319ac7a-c6b0-401d-8699-fbde4ef96c01 tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 978.269286] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-4319ac7a-c6b0-401d-8699-fbde4ef96c01 tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 978.269501] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-4319ac7a-c6b0-401d-8699-fbde4ef96c01 tempest-TenantUsagesTestJSON-1443026195 tempest-TenantUsagesTestJSON-1443026195-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 987.269198] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Starting to schedule for instances: ['74e7c008-ec41-452f-99aa-669e36630b90'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 987.269531] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 987.269695] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 987.269874] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 987.270132] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 987.270701] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 987.310412] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 987.310646] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 987.310814] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 987.317614] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 987.317827] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 987.318216] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 987.318500] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 987.318664] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 987.318834] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 987.319013] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 987.319271] nova-scheduler[51429]: DEBUG nova.filters [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 987.319476] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 81.168353 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 987.319632] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 987.319785] nova-scheduler[51429]: INFO nova.filters [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Filter ComputeFilter returned 0 hosts [ 987.319957] nova-scheduler[51429]: DEBUG nova.filters [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Filtering removed all hosts for the request with instance ID '74e7c008-ec41-452f-99aa-669e36630b90'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 987.320117] nova-scheduler[51429]: INFO nova.filters [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Filtering removed all hosts for the request with instance ID '74e7c008-ec41-452f-99aa-669e36630b90'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 987.320275] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 987.320457] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-76471a14-d602-4b25-8726-2a29163aff5d tempest-ServerDiagnosticsV248Test-1220482493 tempest-ServerDiagnosticsV248Test-1220482493-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 991.313516] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Starting to schedule for instances: ['0f73f6db-1421-4836-9087-b0d040124ec9'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 991.313762] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 991.314133] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 991.314133] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 991.314360] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 991.314896] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 991.366689] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 991.367818] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 991.367818] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 991.377434] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 991.377654] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 991.378052] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 991.378802] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 991.378802] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 991.378802] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 991.379106] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 991.379106] nova-scheduler[51431]: DEBUG nova.filters [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 991.379417] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 85.22816 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 991.379417] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 991.379575] nova-scheduler[51431]: INFO nova.filters [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filter ComputeFilter returned 0 hosts [ 991.379720] nova-scheduler[51431]: DEBUG nova.filters [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filtering removed all hosts for the request with instance ID '0f73f6db-1421-4836-9087-b0d040124ec9'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 991.379855] nova-scheduler[51431]: INFO nova.filters [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filtering removed all hosts for the request with instance ID '0f73f6db-1421-4836-9087-b0d040124ec9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 991.380055] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 991.380228] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-f8a262a1-1b20-4f66-b924-7619bb7cb28e tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 995.608465] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Starting to schedule for instances: ['d8d0c576-992f-4507-99c7-39b8e19a8b65'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 995.608465] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 995.608465] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 995.608465] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 995.608779] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 995.608779] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 995.662761] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 995.662761] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 995.662761] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 995.667789] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 995.668501] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 995.668741] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 995.668741] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 995.669303] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 995.669303] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 995.669303] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 995.669478] nova-scheduler[51429]: DEBUG nova.filters [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 995.669655] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 89.518515 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 995.669841] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 995.672032] nova-scheduler[51429]: INFO nova.filters [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filter ComputeFilter returned 0 hosts [ 995.672233] nova-scheduler[51429]: DEBUG nova.filters [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filtering removed all hosts for the request with instance ID 'd8d0c576-992f-4507-99c7-39b8e19a8b65'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 995.672381] nova-scheduler[51429]: INFO nova.filters [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filtering removed all hosts for the request with instance ID 'd8d0c576-992f-4507-99c7-39b8e19a8b65'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 995.672532] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 995.672678] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-d48f79b5-cebe-4086-974f-e311f605028b tempest-AttachVolumeTestJSON-413909156 tempest-AttachVolumeTestJSON-413909156-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 997.917852] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Starting to schedule for instances: ['fda2a05c-7bce-4250-8182-d2f8c41fca8b'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 997.918658] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 997.918844] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 997.919045] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 997.919265] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 997.919487] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 997.975432] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 997.975735] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 997.975910] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 997.986229] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 997.986469] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 997.987479] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 997.987479] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 997.987772] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 997.987975] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 997.988159] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 997.988426] nova-scheduler[51431]: DEBUG nova.filters [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 997.988796] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 91.837494 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 997.991447] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 997.991447] nova-scheduler[51431]: INFO nova.filters [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filter ComputeFilter returned 0 hosts [ 997.991447] nova-scheduler[51431]: DEBUG nova.filters [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filtering removed all hosts for the request with instance ID 'fda2a05c-7bce-4250-8182-d2f8c41fca8b'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 997.991447] nova-scheduler[51431]: INFO nova.filters [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filtering removed all hosts for the request with instance ID 'fda2a05c-7bce-4250-8182-d2f8c41fca8b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 997.991447] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 997.991447] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-23f7c52b-f77f-4bc4-b476-088bbb547536 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1002.980681] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Starting to schedule for instances: ['f13dcee8-331c-4107-b044-0709b15c9ed0'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1002.980977] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1002.982058] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1002.987019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1002.987019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1002.987019] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1003.033075] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1003.033302] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1003.033465] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1003.040492] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1003.040999] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1003.041099] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1003.041809] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1003.041809] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1003.041809] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1003.041809] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1003.042077] nova-scheduler[51429]: DEBUG nova.filters [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1003.042897] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 96.891168 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1003.042897] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 1003.042897] nova-scheduler[51429]: INFO nova.filters [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Filter ComputeFilter returned 0 hosts [ 1003.042897] nova-scheduler[51429]: DEBUG nova.filters [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Filtering removed all hosts for the request with instance ID 'f13dcee8-331c-4107-b044-0709b15c9ed0'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1003.042897] nova-scheduler[51429]: INFO nova.filters [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Filtering removed all hosts for the request with instance ID 'f13dcee8-331c-4107-b044-0709b15c9ed0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1003.043149] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1003.043149] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-dd46b735-0409-41ee-bf7a-66c6b7d6bf12 tempest-ServerMetadataNegativeTestJSON-312686674 tempest-ServerMetadataNegativeTestJSON-312686674-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1006.517723] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Starting to schedule for instances: ['c3af4bbf-d1b6-4fe6-b6f3-077118ffffc6'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1006.518899] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1006.519175] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1006.519370] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1006.519565] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1006.519743] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1006.529857] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Starting to schedule for instances: ['1088641d-dcb7-4fb3-9fce-6edf044eba09'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1006.530238] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1006.531565] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1006.531565] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1006.531565] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1006.531565] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1006.566537] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1006.566537] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1006.566537] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1006.575326] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1006.575326] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1006.575326] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1006.576348] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1006.576519] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1006.576671] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1006.576832] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1006.577101] nova-scheduler[51431]: DEBUG nova.filters [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1006.577464] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 100.426187 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1006.577659] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 1006.577812] nova-scheduler[51431]: INFO nova.filters [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Filter ComputeFilter returned 0 hosts [ 1006.577958] nova-scheduler[51431]: DEBUG nova.filters [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Filtering removed all hosts for the request with instance ID 'c3af4bbf-d1b6-4fe6-b6f3-077118ffffc6'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1006.578587] nova-scheduler[51431]: INFO nova.filters [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Filtering removed all hosts for the request with instance ID 'c3af4bbf-d1b6-4fe6-b6f3-077118ffffc6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1006.578587] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1006.578587] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-572b1664-6695-4077-a4cc-bc3d221337f4 tempest-ServersTestManualDisk-761691693 tempest-ServersTestManualDisk-761691693-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1006.591164] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1006.591405] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1006.591574] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1006.600520] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1006.600740] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1006.601136] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1006.601427] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1006.601607] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1006.601761] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1006.601930] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1006.602200] nova-scheduler[51429]: DEBUG nova.filters [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1006.602470] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 100.451286 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1006.602701] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 1006.602872] nova-scheduler[51429]: INFO nova.filters [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Filter ComputeFilter returned 0 hosts [ 1006.603364] nova-scheduler[51429]: DEBUG nova.filters [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Filtering removed all hosts for the request with instance ID '1088641d-dcb7-4fb3-9fce-6edf044eba09'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1006.603364] nova-scheduler[51429]: INFO nova.filters [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Filtering removed all hosts for the request with instance ID '1088641d-dcb7-4fb3-9fce-6edf044eba09'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1006.603549] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1006.603701] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-71fba461-e8a8-46ab-99bf-6c6664f0a400 tempest-ServersNegativeTestMultiTenantJSON-1694403878 tempest-ServersNegativeTestMultiTenantJSON-1694403878-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1014.700881] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Starting to schedule for instances: ['23647652-d8e1-4f83-bb50-3d408d62741c'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1014.700881] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1014.700881] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1014.700881] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1014.700881] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1014.700881] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1014.746756] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1014.748468] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1014.748468] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1014.754367] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1014.754721] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1014.755222] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1014.755660] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1014.755940] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1014.756251] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1014.756627] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1014.757014] nova-scheduler[51431]: DEBUG nova.filters [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1014.757333] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 108.606185 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1014.761273] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 1014.761273] nova-scheduler[51431]: INFO nova.filters [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filter ComputeFilter returned 0 hosts [ 1014.761273] nova-scheduler[51431]: DEBUG nova.filters [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtering removed all hosts for the request with instance ID '23647652-d8e1-4f83-bb50-3d408d62741c'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1014.761273] nova-scheduler[51431]: INFO nova.filters [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtering removed all hosts for the request with instance ID '23647652-d8e1-4f83-bb50-3d408d62741c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1014.761273] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1014.761614] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-bf2c9584-667e-4a30-b9b2-83f3ae89c328 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1017.411533] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Starting to schedule for instances: ['c334cdf9-22bd-402c-a474-dd33deaca038'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1017.411823] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1017.411985] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1017.412184] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1017.412418] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1017.412613] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1017.451815] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1017.452059] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1017.452242] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1017.459033] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1017.459247] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1017.459597] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1017.459866] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1017.460075] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1017.460242] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1017.460401] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1017.460645] nova-scheduler[51429]: DEBUG nova.filters [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1017.460848] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 111.309728 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1017.461036] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 1017.461205] nova-scheduler[51429]: INFO nova.filters [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filter ComputeFilter returned 0 hosts [ 1017.461355] nova-scheduler[51429]: DEBUG nova.filters [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtering removed all hosts for the request with instance ID 'c334cdf9-22bd-402c-a474-dd33deaca038'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1017.461490] nova-scheduler[51429]: INFO nova.filters [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtering removed all hosts for the request with instance ID 'c334cdf9-22bd-402c-a474-dd33deaca038'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1017.461636] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1017.461777] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-8549088e-5c13-4b75-892f-77f05583768e tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1020.000075] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Starting to schedule for instances: ['53cdf163-fffd-4b5c-883c-1e38139a08f0'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1020.000408] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1020.000567] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1020.000744] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1020.000994] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1020.001238] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1020.039833] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1020.040214] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1020.040473] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1020.047651] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1020.047895] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1020.048303] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='3',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_60a64c047df340008256e691a618d959='1',num_proj_6cc419217094416381972f1ec63d776f='1',num_proj_b54ecd325ea04fb58510dbc4b236d0e3='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='1',num_proj_de7e8d74ff79471c9b29bb62d6ca8f7b='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:51:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=7) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1020.048638] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1020.048837] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 50, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1020.049036] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Update host state with instances: ['2545ca35-7a3f-47ed-b0de-e1bb26967379', '71554abb-780c-4681-909f-8ff93712c82e', '789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '06d5ac6a-7734-46e3-80c5-d960821b7552', '64bc3ac9-57b4-4f50-97fa-ba684c1595b4'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1020.049237] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1020.049513] nova-scheduler[51431]: DEBUG nova.filters [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1020.049742] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:50:22. Elapsed time is 113.898604 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1020.049906] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 1020.050108] nova-scheduler[51431]: INFO nova.filters [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filter ComputeFilter returned 0 hosts [ 1020.050285] nova-scheduler[51431]: DEBUG nova.filters [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtering removed all hosts for the request with instance ID '53cdf163-fffd-4b5c-883c-1e38139a08f0'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1020.050427] nova-scheduler[51431]: INFO nova.filters [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtering removed all hosts for the request with instance ID '53cdf163-fffd-4b5c-883c-1e38139a08f0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1020.050575] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1020.050719] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-48cf75e3-f7b2-4076-9367-2162178c24f3 tempest-AttachVolumeNegativeTest-2016871791 tempest-AttachVolumeNegativeTest-2016871791-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1025.452432] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1025.452686] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1025.452811] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1025.452847] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1025.452959] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1025.453011] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1025.453152] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1025.453311] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1025.453548] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1025.453727] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1025.456550] nova-scheduler[51431]: INFO nova.scheduler.host_manager [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1025.456634] nova-scheduler[51429]: INFO nova.scheduler.host_manager [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1025.456765] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1025.456812] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-d26b1fc3-f992-4d1b-a61c-52ef9fca251f None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1028.256915] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c99527b5-76ca-4497-95ce-a14f6b4175ab tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1028.257234] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c99527b5-76ca-4497-95ce-a14f6b4175ab tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1028.257412] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c99527b5-76ca-4497-95ce-a14f6b4175ab tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1028.257576] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c99527b5-76ca-4497-95ce-a14f6b4175ab tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1028.257791] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c99527b5-76ca-4497-95ce-a14f6b4175ab tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1028.257960] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c99527b5-76ca-4497-95ce-a14f6b4175ab tempest-ServerDiagnosticsTest-1458258893 tempest-ServerDiagnosticsTest-1458258893-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1078.703479] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-330b38d0-0cec-49e8-956e-6ca1920a6d88 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1078.703479] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-330b38d0-0cec-49e8-956e-6ca1920a6d88 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1078.703813] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-330b38d0-0cec-49e8-956e-6ca1920a6d88 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1078.703946] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-330b38d0-0cec-49e8-956e-6ca1920a6d88 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1078.703998] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-330b38d0-0cec-49e8-956e-6ca1920a6d88 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1078.703998] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-330b38d0-0cec-49e8-956e-6ca1920a6d88 tempest-VolumesAdminNegativeTest-2131673682 tempest-VolumesAdminNegativeTest-2131673682-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1098.225191] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c238f67f-513c-4473-b08c-c33fc5076680 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1098.225481] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c238f67f-513c-4473-b08c-c33fc5076680 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1098.225674] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c238f67f-513c-4473-b08c-c33fc5076680 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1098.225734] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c238f67f-513c-4473-b08c-c33fc5076680 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1098.225792] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-c238f67f-513c-4473-b08c-c33fc5076680 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1098.225857] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-c238f67f-513c-4473-b08c-c33fc5076680 tempest-DeleteServersAdminTestJSON-1182615883 tempest-DeleteServersAdminTestJSON-1182615883-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1099.896510] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Starting to schedule for instances: ['c66cf6fc-7b50-4e55-b4f1-da50cf1241e3'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1099.896816] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1099.896984] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1099.897182] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1099.897376] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1099.897558] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1100.003163] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1100.003397] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1100.003562] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1100.012025] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1100.012025] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1100.012025] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='8',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='1',num_task_spawning='2',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:53:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=3) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1100.012025] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1100.012025] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 52, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 52, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1100.012025] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Update host state with instances: ['789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '2e622c9d-369c-4c36-a477-3237bea4cf7c', '9745bc90-6927-46a9-af48-df69046dc2a2'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1100.012482] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1100.012855] nova-scheduler[51429]: DEBUG nova.filters [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1100.013198] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:52:22. Elapsed time is 73.862031 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1100.013478] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 1100.013745] nova-scheduler[51429]: INFO nova.filters [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Filter ComputeFilter returned 0 hosts [ 1100.014016] nova-scheduler[51429]: DEBUG nova.filters [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Filtering removed all hosts for the request with instance ID 'c66cf6fc-7b50-4e55-b4f1-da50cf1241e3'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1100.014288] nova-scheduler[51429]: INFO nova.filters [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Filtering removed all hosts for the request with instance ID 'c66cf6fc-7b50-4e55-b4f1-da50cf1241e3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1100.014549] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1100.014806] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-0e57ed56-4035-430a-b349-3cb81c717232 tempest-ServersAdmin275Test-1353520415 tempest-ServersAdmin275Test-1353520415-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1104.623123] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Starting to schedule for instances: ['bdf617dc-33e3-462d-a1e0-3b9767204eb6'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1104.623438] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1104.623608] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1104.624038] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1104.624038] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1104.624262] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1104.665084] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1104.665338] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1104.665505] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1104.672063] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1104.672275] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1104.672640] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='8',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='1',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='1',num_task_spawning='2',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:53:33Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=3) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1104.672911] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1104.673096] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 52, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 52, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1104.673255] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Update host state with instances: ['789a3358-bc70-44a5-bb2f-4fc2f1ff9116', '2e622c9d-369c-4c36-a477-3237bea4cf7c', '9745bc90-6927-46a9-af48-df69046dc2a2'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1104.673414] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1104.673657] nova-scheduler[51431]: DEBUG nova.filters [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1104.673926] nova-scheduler[51431]: DEBUG nova.servicegroup.drivers.db [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:52:22. Elapsed time is 78.522742 {{(pid=51431) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1104.674108] nova-scheduler[51431]: WARNING nova.scheduler.filters.compute_filter [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 1104.674264] nova-scheduler[51431]: INFO nova.filters [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Filter ComputeFilter returned 0 hosts [ 1104.674976] nova-scheduler[51431]: DEBUG nova.filters [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Filtering removed all hosts for the request with instance ID 'bdf617dc-33e3-462d-a1e0-3b9767204eb6'. Filter results: [('ComputeFilter', None)] {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1104.674976] nova-scheduler[51431]: INFO nova.filters [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Filtering removed all hosts for the request with instance ID 'bdf617dc-33e3-462d-a1e0-3b9767204eb6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1104.675285] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] Filtered [] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1104.675496] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-987f4cac-ecf1-4ff4-b2cc-f3e893124f23 tempest-ServerRescueTestJSON-1134944411 tempest-ServerRescueTestJSON-1134944411-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51431) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1128.204863] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-17d85dde-f013-475d-8fc4-eacad5043b2f tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1128.205130] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-17d85dde-f013-475d-8fc4-eacad5043b2f tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1128.205269] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-17d85dde-f013-475d-8fc4-eacad5043b2f tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1128.205308] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-17d85dde-f013-475d-8fc4-eacad5043b2f tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1128.205354] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-17d85dde-f013-475d-8fc4-eacad5043b2f tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1128.205392] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-17d85dde-f013-475d-8fc4-eacad5043b2f tempest-ServerShowV254Test-1763719203 tempest-ServerShowV254Test-1763719203-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1146.704122] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Starting to schedule for instances: ['29f6b4fa-7df1-49ba-94ad-ee3dc3a9126d'] {{(pid=51429) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1146.704428] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51429) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1146.704666] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1146.704739] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1146.704935] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51429) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1146.705143] nova-scheduler[51429]: DEBUG nova.scheduler.request_filter [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] ephemeral_encryption_filter skipped {{(pid=51429) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1146.746752] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1146.746979] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1146.747168] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1146.754674] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1146.754860] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1146.755210] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_5ea8a2bfcb214fecb3a7afea860a90da='0',num_proj_cc08c67065e0450e87f01130f1571b3f='1',num_proj_d239a4f0ed5b48cf9cd9a334de6f189c='0',num_proj_ea06d39d80ab4c7db76925f3550795fa='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:54:03Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=2) {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1146.755485] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state with aggregates: [] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1146.755654] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 52, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 52, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1146.755809] nova-scheduler[51429]: DEBUG nova.scheduler.host_manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state with instances: ['2e622c9d-369c-4c36-a477-3237bea4cf7c', '9745bc90-6927-46a9-af48-df69046dc2a2'] {{(pid=51429) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1146.755966] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1146.756233] nova-scheduler[51429]: DEBUG nova.filters [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Starting with 1 host(s) {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1146.756450] nova-scheduler[51429]: DEBUG nova.servicegroup.drivers.db [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-31 09:52:22. Elapsed time is 120.605318 {{(pid=51429) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1146.756606] nova-scheduler[51429]: WARNING nova.scheduler.filters.compute_filter [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 1146.756767] nova-scheduler[51429]: INFO nova.filters [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter ComputeFilter returned 0 hosts [ 1146.756912] nova-scheduler[51429]: DEBUG nova.filters [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filtering removed all hosts for the request with instance ID '29f6b4fa-7df1-49ba-94ad-ee3dc3a9126d'. Filter results: [('ComputeFilter', None)] {{(pid=51429) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1146.757062] nova-scheduler[51429]: INFO nova.filters [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filtering removed all hosts for the request with instance ID '29f6b4fa-7df1-49ba-94ad-ee3dc3a9126d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1146.757209] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filtered [] {{(pid=51429) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1146.757350] nova-scheduler[51429]: DEBUG nova.scheduler.manager [None req-21416bcf-5866-4fb3-8727-740404c0ce19 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51429) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1149.244465] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Starting to schedule for instances: ['3c337acb-ce39-44b5-a898-b40d7f4d5234'] {{(pid=51431) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1149.244781] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51431) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1149.244926] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1149.245120] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1149.245317] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51431) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1149.245512] nova-scheduler[51431]: DEBUG nova.scheduler.request_filter [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] ephemeral_encryption_filter skipped {{(pid=51431) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1149.284869] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1149.285103] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1149.285273] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1149.294968] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1149.295195] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1149.295532] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-31T09:44:17Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='12'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-31T09:54:24Z,uuid=693f1d2b-e627-44fb-bcd5-714cccac894b,vcpus=48,vcpus_used=0) {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1149.295796] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state with aggregates: [] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1149.295962] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state with service dict: {'id': 6, 'uuid': '977ebcc9-0f98-4140-a64a-056a375b88ca', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 6, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 31, 9, 54, 22, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 31, 9, 44, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 31, 9, 54, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1149.296129] nova-scheduler[51431]: DEBUG nova.scheduler.host_manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Update host state with instances: ['2e622c9d-369c-4c36-a477-3237bea4cf7c', '9745bc90-6927-46a9-af48-df69046dc2a2'] {{(pid=51431) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1149.296353] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1149.296615] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Starting with 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1149.296813] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.296985] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.297195] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.297360] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.297524] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.297722] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.297898] nova-scheduler[51431]: DEBUG nova.filters [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51431) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1149.298088] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1149.298273] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51431) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 1149.298451] nova-scheduler[51431]: DEBUG nova.scheduler.utils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Attempting to claim resources in the placement API for instance 3c337acb-ce39-44b5-a898-b40d7f4d5234 {{(pid=51431) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 1149.349172] nova-scheduler[51431]: DEBUG nova.scheduler.manager [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] [instance: 3c337acb-ce39-44b5-a898-b40d7f4d5234] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51431) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 1149.349458] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1149.349656] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1149.349853] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-2002e003-76ff-402d-b795-06d85bfc3029 tempest-AttachVolumeShelveTestJSON-824139339 tempest-AttachVolumeShelveTestJSON-824139339-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1150.441390] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1150.441652] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1150.441927] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1150.442121] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1150.442289] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1150.444826] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1150.445082] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1150.445388] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Acquiring lock "11743078-64bf-4468-a786-557c60808969" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1150.445567] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "11743078-64bf-4468-a786-557c60808969" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1150.445727] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "11743078-64bf-4468-a786-557c60808969" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1150.447734] nova-scheduler[51429]: INFO nova.scheduler.host_manager [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1150.447944] nova-scheduler[51429]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.006s {{(pid=51429) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1150.449431] nova-scheduler[51431]: INFO nova.scheduler.host_manager [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1150.449900] nova-scheduler[51431]: DEBUG oslo_concurrency.lockutils [None req-f9da831e-87c6-42e0-af71-02357d63b62c None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=51431) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}